Welcome to the JMP Development Update for June 16, 2023!
We are now in JMP 17.2 Approval Mode. A few approval requests have been made this week to address recently reported customer issues. Thank you for all the triage work on Jira issues that have 17.2 in the Planned Version field - you can adjust this filter to look for any stray items that may be assigned to you. This saved filter includes items in Developing status (~20 items) as well as items in Initiated Status (~170 items). If you notice items on this list that you do not plan to request approval to push in 17.2, please remove 17.2 from the Planned Version field. This is very helpful in assessing what fixes may still be coming before JMP 17.2 Code Freeze on July 30th.
Before we get there, we’ll be freezing JMP 18 EA4 at the end of the day next Friday, June 23rd. To help get EA4 in the hands of EA members quickly and drive feedback in a timely manner, please update your feature pages and/or create new pages for any features you’d like to highlight in EA4. The due date for feature page updates, EA videos and EA usability studies is Tuesday, June 27. Please reach out to Mia Stephens with any questions. Remember, you can add anything you want to share about a feature to the feature page. Example data sets, usability studies, sample code, screenshots, references, and other links will help early adopter members and will be very useful to team developing marketing and internal technical training materials as we pass our development and marketing feature freeze on July 20th.
Bradley Jones shared some very big news this week this week with the announcement of his retirement this July after 25 years leading JMP’s DOE research and development efforts. As John Sall shared in his tribute email, Brad’s contributions have made JMP a first in class tool for scientists seeking to design efficient experiments and analyze the results. His research innovations have been widely published with internal and external collaborators and have been awarded many patents over the years. Brad has entrusted Ryan Lekivetz with the future leadership of the DOE team. Ryan has already proven himself a capable and collaborative leader as manager of the group and will now report directly to John Sall. I’m told Brad has a standing invitation to lunch with the DOE group and plans to continue to use the SAS gym, so I’m sure he won’t be a stranger to campus. Congratulations to Brad as he embarks upon this new chapter of his life’s book – may it be as fulfilling as the adventures that have come before!
General Announcements
- Interested in presenting at a future JMP Dev meeting? Please add your preferred date, presenter name(s) and topic to the JMP Dev Meeting Volunteer Schedule page in Confluence!
- If you’re willing to be a featured employee on Inside JMP, please download a copy of the Get to Know form. Simply fill out the questions and when you’re done, upload it, along with 3 photos of you to the folder. Thank you for helping to make our JMP family a little more familiar!
Important Upcoming Dates
- JMP 18 EA4 Freeze – 6/23/23
- JMP 17.2 Code Freeze – 6/30/23
- JMP 18 Feature Freeze – 7/21/23
- JMP 18 EA5 and JMP Clinical EA3, JMP Live 18 EA1 – 8/11/23
- JMP 18 EA6 and JMP Clinical EA4 – 10/3/23
- JMP 18 EA7 and JMP Clinical EA5 – 12/8/23
- Please visit Confluence for a full list of JMP 17 and JMP 18 dates.
JMP Development Updates
Interns
- Elon student Evan Carr was featured in a Meet the Interns article on Inside JMP this week. Palomar College student Michael Lee was also featured in an article you can read here, as was App State student Trevor Rathje.
- Momena: Got training on the Six Sigma JMP tool. Observed training sessions provided by JMP to customers like Schweitzer Engineering Laboratories on map creation. Completed drafting the Technical Reference Library survey for the SE's worldwide and discussed upcoming plan to work with the TRL. Searched 20 contents in the TRL to recommend for retirement. Started creating a chart to better categorize the contents in the TRL. Did survey and added more information to the Broadcom business opportunity database.
- Parker: This past week was spent learning JSL and brainstorming a final project. I’m thinking of using JSL to pull weather data from the internet and create a dashboard on JMP Live that can animate current weather patterns. I have started the data importation step with HTTP requests, and next week I’ll see what I can animate within JMP in the hopes of presenting this at the intern expo. Your ideas for catchy weather-related titles are welcome!
- Hamid: Meeting with stat writers and documentation teams. Finalizing my SLS_Examples project. Advancing on my Mediation analysis example for the SEM chapter. I started working on my new project regarding existing data tables. Attended intern meetings and completed courses "Acceptable Use of SAS Systems and Networks" and "Social Engineering and Phishing."
- Hailee: Working with the team on creating a follow-up communication for the events team to send to advocates after JMP Inspire events. Along with that, I have been helping Robin plan the upcoming Austin User Group Event by researching potential venues. I have also continued to learn about events through shadowing meetings with the team.
- Sohail: Continued to work on cleaning the data this week and putting together reports on issues with the data. I also had the opportunity to begin training some models and we have already begun to see huge performance gains over the default model, bringing the translation accuracy close to that of human translators.
- Abrah: I am excited to present my new blog post that was published this week! Here is a link to the post: https://community.jmp.com/t5/JMP-Blog/Everyone-Can-Grow-Getting-Your-Hands-Dirty-with-DOE/ba-p/638377
- Brad: Finished a blog post on regular expressions, hoping to have it published soon! I also continued to work on my chat-bot and have started front-end development for a proof-of-concept.
- Anusha: Working on unit tests for JMP clinical 17.2 version and trying to finish STIPS courses. I am looking forward to running as many unit tests as possible and learning from the challenging ones.
- Trevor: Working on a report for tech support analyzing P&G cases. I have gathered data and used JMP to building graphs and visuals that show trends to help our tech support team.
- Emily: Editing the 12 Tips of the Day Videos and have been getting feedback for more finalized drafts. I am also coming up with edits for the Graph Builder chapter of Essential Graphing.
Data Discovery
- Evan: Developed JMP Telemetry Explorer Add-In. Added telemetry for gaps noticed from EA3 telemetry. These include table cell context menu usage, column renames, formula editor initiation and usage, column info dialog initiation, header graph toggling, table tools initiation, and column utilities initiation. Platform Templates rendering updates for remapping columns outside of Roles and for ScaleBox customizations.
- Dan S: Refactored drag-and-drop column replacement in Distribution to avoid platform rerun. Enabled Platform Templates on the Distribution var outlines. Ongoing work related to Group Platform.
- Dave B: Finishing up 17.2 integrations, fixed a text box tab positions problem on Windows, fixed a scatterplot rerun problem, fixed a couple of minimized text annotation issues
- Xan: Graph export and GB properties bugs. Trying a confluence plan page.
DOE
- Caleb: Added support for multiple factors in the new CSALT platform. I’ve also been working with Yeng to make the reverse-search lookup in the sample size explorers more robust to extreme settings, based on tickets from customers. Also, I submitted the paper with Brad to Technometrics.
- Brad: Caleb King and I submitted a paper to Technometrics on an alternative to Lenth’s method. JMP uses Lenth’s method in more than one place. Our new method outperforms Lenth’s method. It also works for nonothogonal designs which Lenth’s method does not.
- Peng: Continue JMP 18 development and maintenance on both Reliability and DOE. Going through formal processes to finalize two publications.
Host
- Paul:
- Updated windows Python from 3.11.2 to Python 3.11.4 due to security issues and fixes to package handling. Craige Hales reported an issue with EA3 in the Run Program environment. His command line environment was picking up JMP’s python.exe instead of the python 3.9 he was expecting, so none of his installed packages were found. We only use python.exe for running the pip package installation module. With this update, I am now able to reliably run the pip3.11.exe instead of needing the python.exe, so python.exe and pythonw.exe have been removed from the install starting tonight.
- This update also solved several packing installation issues that both Russ and I have had with various Python packages. Before pyopencl, pyarrow, and some others required different installation options than the jpip wrapper script utilized; now all work just fine with the updated wrapper script using pip3.11.exe. The script has changed as it no longer hides the pip command arguments, only wrappers the environment variables.
So before:
C:\my_path> jpip numpy pandas
Is now,
C:\my_path> jpip install --user numpy pandas
- I have created a Python-side wrapper class for a JMP shared pointer. I can now create a new empty JMP Data Table from Python. Setting the name and row count in construction is the current state of implementation. Adding columns and filling / setting / querying data is top priority for next week.
- Deprecating many of the JSL Python functions that no longer apply since Python is always present. Working with Kimi(Yu) Wang ensuring deprecation warnings are consistent and appropriate. Trying to ensure that all the change happens now, rather than to trickle out deprecations. I want to ensure there is only 1 large transition for users to accommodate.
- John Schroedl: Telemetry work with Audrey, David White and Evan. Includes a plan for JMP employees to self-identify so that we can distinguish our telemetry data from customers. Will also be used to populate crash reporting dialog for non-anonymous submission. Icon work including image size discussions. Met with Mark Bailey and others re: the possibility of using our telemetry server to accept customer UX study results. Worked with Dan S. on menu parsing issue. Failed attempts at diagnosing MATLAB init failure on Windows.
- Michael H: Added messages to JMP 17.2 to inform users that SAS Integration is going away in JMP 18. Fixed bugs in PI Server Import “Change Attributes” command.
Interactive HTML
- Paul Spychala: Committed several Mosaic Live/HTML tooltips bugs and issues (JMPHTML-1920, JMPHTML-1902, JMPHTML-2108, JMPHTML-2179). Refactored the Mosaic Segment and Score calculations into ES6. Fixed border drawing in Live/HTML for Dendrogram and CCB (JMPHTML-2169). Enabled Dendrograms with Distance Graphs in Live/HTML (JMPHTML-2172). Conditional Least Squares Profilers (predictions) now correctly work in Live/HTML (JMPHTML-2178). Adjusted Live/HTML axis drawing of nominal values to show more values (JMPHTML-2144). Updated our internal testing “singletest” tool with bug fixes and new features.
- Praveena: Continuing work on supporting to change legend item color for reports published to JMP Live. Worked with Michael Goff for the setting the communication channel and passing data required for the colorPicker component. Working on exporting menu items for Distribution platform to interactive HTML reports. Met with Laura Lancaster & John Powell to understand how to retrieve menu options and states while exporting.
- John Powell: Implementing support for multiple local data filters on JMP Live (JMPHTML-1000). Updating local data filters to use ‘???’ for missing (JMPHTML-2185). Adding number of matching rows text to local data filter (JMPHTML-2151). Answered a JMP community question about dashboards with multiple local data filters. Added a wish list item inspired by a JMP Community Post. (Data Probe). Enable reports with ‘Nested Y and Order By’ to find cases that don’t work(JMPHTML-2150).
Statistics
- Jianfeng: Working on bug fixes and integrations for JMP 17.2. I am also implementing the new feature JMP-3548 of equivalence test in matched pairs platform requested by customers. The feature is not fully done yet but the progress has been made. Thanks!
- John Sall: Fixed Fit Least Squares inverse-transform profiler axis (JMP-17153). Fixed Fit Response Screening DF Denominator and decimal width (JMP-17143). Changed Fit Model dialog from "Random Group" to "Grouped Regressors" (JMP-17105). Better support transforms in crossed effects in Fit Model dialog (JMP-9789). Rearranged comboBoxes in Fit Model dialog to avoid extra-wide window due to GLMM menu text (JMP-13978). In Design Space Profiler - improve message for small volume situation (JMP-15151). Fit Stepwise now uses FitGroup for multiple Y's (JMP-16994). In Fit Model Dialog it now shows a checkBox for Center Polynomials for mixed models (JMP-17010). And the Profiler platform now supports using confidence limit formula columns (JMP-17150). The feature does not require you to specify the confidence formulas to the platform - it will search for and find them. This will enable us to do non-symmetric intervals in various platforms.
- Elizabeth: Working on some changes to the Mixed report after some recent customer conversations to hopefully lower the barrier to entry for a switch from other products to JMP Pro. Fixed a bug Fang found with Sequential Tests and GLMMs with repeated measures structures (JMP-17132). Also investigating a bug Paul Spychala found in the platform conditional profilers when he was implementing random effects into the HTML5 profilers (JMP-17149) that appears to have been introduced back in v16.
- Annie: Added JSL support for setting Product Statistics for the Short Run control charts. Based on feedback from the Short Run Usability study for Short Run Control Charts, I added an LRT to the Product Statistics outline box with menu commands duplicate to the Short Run Product commands on the platform-level LRT.
- Laura C-S: Fixed and integrated a few bugs in SEM, including a crash. Wrapped up display issues involving adding icons and hover labels to lists of edges and tables of parameter estimates in SEM.
Stat Documentation
- Michael C: Prepped stat books for handoff to doc team for EA4 help production tasks; reviewed some updated Standard Least Squares examples that Hamid worked on last week; investigated impact on stat documentation of proposals to remove crime and Boston Housing sample data tables.
Stat Testing
- Jacob: Verifying DOE Jira tickets for 17.2. Reviewing HCI International paper with Mark Bailey, Ryan Lekivetz, and Joseph Morgan. Testing Make Validation Column.
Product Management
- Bryan F: Developing icons and prototypes, modifying designs based on feedback, and having discussions about a style guide. Accessibility requests keep coming. I'm here to partner with developers to improve in this area. Each new feature is a fresh opportunity to enhance accessibility.
Technical Support
- Duane: TS has seen a few minor changes with the recent Salesforce update, but, we are working through them. Members of TS met with Product Management to talk about an efficient process for handling user suggestions and wishlist items. And, as usual, here are the TS JMP Live reports and the link to the Jira filter showing the tickets reported by TS for the last 14 days.
Development Operations
- Bob: Coordination of Subscription download on new JMP Store. Continued work on strategy for digitally signed files for 18. Work on getting 18 installers signed during creation. Published string updates for 17.2/18 installers.
- Myron: Worked on JMPTOOL-861, installing software and getting various scripts to work for the help build.
Documentation
- Qiana: Did sample data table work. Planned for EA4. Reviewed the updated Quick Start. Addressed a few Jiras for AR and Cards. Ran production check scripts on my assigned books for EA4. Starting making updates to the Learn About JMP chapter. Created the Update Metadata in PDF Files page.
- Susan C: Working on Quick Start content. Incorporated feedback from review and updated HTML files. Added files to Perforce. Production checked books for EA 4.
- Devon: Prepping our documentation for EA4, working on the scripts we use to produce them.
System/Host Testing-Cary
- Mandy: Worked on Crime.jmp and CrimeData.jmp to save them to this location in perforce [ dt = Open( ut home || "tests/DataTable/SourceTables/Crime.jmp" ) ]. This allows testing to remain the same except for changing one line in a test. Reworked tests that involved using these tables. Reviewed the skip a step Icon for Workflow builder – had adjustments made to make it readable for dark mode on Mac. Testing workflow error messages changes in 18. Did 17.2 early installer testing for our group – found no big problems. Bill Worley shared a problem where his workflow was not recording Graph Builder steps at 17.1. David White discovered it was because Bill had the Template Add-in installed. FYI for SEs: if they have the Template Add-in, they may need to disable or remove it, when demoing to users (JMP-17116).
- Hunter: Started JMP 17.2 Early Installer Testing. Encountered a crash with the Search window exclusive to JMP Subscription on Mac (JMP-17152) that Evan is investigating now. Worked with Jim B. to apply Sonoma 14.0 Developer Beta 1 on the new Intel host testing Mac in the lab.
- Nick H: Started work on some performance testing for Evan’s new Universal Where 18 feature. Fixed some failures and DNCs in the JSL Unit Tests, some of which were related to the removal of the Statistics Index. Started early installer testing for JMP 17.2. Verifed a number of 18.0 bugs, adding unit tests and image tests to the framework. Identified and worked with Aaron on a crash in projects caused by the project contents save dialog being used incorrectly for the project itself.
- Audrey: Jira admin work, Early Installer Testing for JMP 17.2, brainstorming with John Schroedl, David White, Evan McCorkle on the idea of scrubbing employee data from telemetry data, onboarding for Rebecca.
System/Host Testing-Beijing
- Beijing Team:
- Eric (Nai) Wang: (1) Investigating JMP Live JSL test failures, intended for both 17.2 and 18.0. (JMPTESTBJ-2411, JMPTESTBJ-2417, JMPTESTBJ-2416). (2) Refactor common function "WaitActionDone()" to wait until get the succeeded log. Also update related tests (JMPTESTBJ-2469). (3) Complete JMP Live 18.0 I18N Testing Round 1. (4) Working on JMP Clinical I18N testing Round2. (5) Complete JMP 17.2 Early Install Testing. (6) Bug Verification.
- Da Li: (1) In-Progress: Feature testing (JMP-16654: PI Server Import: Update, Change Attributes for existing data table, JMP-16880: PI Server Import: "Update" table script) (2) TS 00043261 investigation and created bug JMP-17059: Copy charts/diagrams and paste to Pages app on Mac does not work well. (3) DONE: JMP 17.2 Early Install Testing. (4) DONE round 1/6 JMP Live 18.0 I18N testing. (5) Bug verification.
- Mike Wu: (1) JMP C 17.2 I18N Testing Round 2. (2) Tested the performance when opening big size (500,000 rows) table from MySQL with latest JMP Pro 17.2&18.0 to compare with MySQL workbench and provided the test result in https://jmpdiscovery.atlassian.net/browse/JMPPRODMGMT-271. (3) JMP 17.2 Early Install Testing. (4) JMP Live 18.0 I18N testing round 1/6 DONE. (5) bug verification.
- Kimi (Yu) Wang: (1) New Feature testing for Python, removed some JSL Python functions, for details please refer to JMP-16815, JMP-16901, JMP-17043, JMP-17044, JMP-17045, and JMP-17063. (2) New Feature testing for SAS deprecation message (JMP-15995). (3) JMP C 17.2 I18N Testing - Round2. (4) JMP Live 18.0 I18N Testing. (5) bug verification. (6) Jenkins: Add compatibility testing for both mac and win, details refer to JMPTESTBJ-2219. Add per file manually for JMP 18 AL UT, for details refer to JMPTESTBJ-2474. Updated Schedule/Pipeline Flow/Configuration for JMP and JMP Live Testing on Jenkins - China R&D JMP Testing Team
- Da Zhang: (1) JMPC 17.2 i8n testing. (2) JMP 17.2 early install testing. (3) Fixed OLE automation failures. (4) bug verification.
- Nala: (1) JMPC 17.2 i8n testing. (2) JMP 17.2 early install testing. (3) bug verification.
Note from Shannon
Big congratulations go out this week to Sarah Seligman from JMP Tech Support who welcomed baby daughter Claire Elizabeth Seligman this week! Claire was born on 6/12/23 at 7:26am, at 5lb 15oz, 18.5 inches long. Sarah shares that they are all doing well!
