If you checked the April Anniversaries and New Hires page on Inside JMP, then you probably noticed that devops developer Nick Ruva celebrated his 10 year anniversary in April. Nick pioneered the use of Jenkins for task automation in JMP Development. Over the years, he has helped us automate many processes, most notably CI for multiple build types, auto integrate to better protect the release branch, nightly builds and unit tests. Nick has coached many others on the DevOps team on how to use Jenkins to automate routine testing tasks, localization work and doc production processes. This year Nick will help us consider options for moving JMP builds and other projects into AWS. Thanks, Nick, we appreciate everything you do to keep our important projects running, and thanks as always for nudging them along when they get stuck!
Welcome to the JMP Development Update for April 29, 2022!
A reminder that we are set to freeze for JMP 17 EA8 at the end of the day on May 3. Please update your feature pages with any last minute updates and fixes that you want our early adopters to know about. We are nearing our final EA, currently planned to freeze in early July. If you are ready to present new features at a JMP Dev meeting, please contact me about getting a placeholder on the calendar! Presentations are tremendously helpful for the broader team to learn about what we’re adding in JMP 17.
JMP Life Sciences Director of Testing Wenjun Bao shared that the JMP LS team had a heavy presence at the virtual MCBios conference this week. John Sall presented an opening keynote titled “Hierarchical Clustering for Large Genomics Applications”. Russ Wolfinger and Wenjun hosted a workshop on advanced analytics and machine learning where Russ demoed new JMP functions and Wenjun facilitated questions. She generated quite a bit of interest from attendees by drawing winners for workshop prizes using JMP to create random subsets of the attendee list.
Wenjun chaired a session called “Text Analytics for Drug Safety and Health Data” session where she presented the talk “A novel approach to predict drug DILI potential using FDA drug labeling” using JMP Text Explorer and XGBoost. Wenjun shared that she received many compliments on John’s presentation and that Russ’s workshop and her presentation had lively Q&As. She also got a few requests for JMP/JMP Pro licenses and passed them along to JMP sales.
Elizabeth Claassen and Caleb King joined Tom Donnelly this week at the DATAWorks conference, held in person in Alexandria, VA. Caleb says that he was glad to reconnect with colleagues and make some new contacts. He particularly enjoyed talks that shared ideas for helping the defense community share data and collaborate better within their organizations.
Anne Milley invited neuroscientist, author, and Vanderbilt professor Suzana Herculano-Houzel to speak at an upcoming JMP event, and received this email in reply: “You caught me doing one of my favorite things in the world: I'm up to my eyeballs in multiple JMP tables and graphs, going through data on a bunch of new species of reptiles and birds that, added to the mammals in my dataset, turn out to let me peek at the insides of the brains of... dinosaurs!!! (did you get from my papers that I'm a loyal JMP user?” Anne said she loves Suzana’s enthusiasm for what she does!
Thanks very much to John Powell, Bryan Fricke, Josh Markwordt, Mayowa Sogbein, Praveena Panineerkandy, and Paul Spychala for demoing updates to interactive HTML for JMP 17 at yesterday’s JMP Dev meeting! This is an exciting release for the team, and will be much appreciated by JMP desktop HTML creators as well as JMP Live customers. If you missed the meeting, you can find a downloaded copy of the recording here. If you’d like to demo at a future dev meeting, please let me know. Laura Castro-Schilo will share JMP 17 SEM updates on May 5 but other than that, the calendar is open through May and the summer!
General Announcements
- If you’re willing to be a featured employee on Inside JMP, please download a copy of the Get to Know form. Simply fill out the questions and when you’re done, upload it, along with 3 photos of you to the folder. Thank you for helping to make our JMP family a little more familiar!
Important Upcoming Dates
- JMP 17.0 EA7 – 3/11/22
- Third Weekend Maintenance – 4/15/22 - 4/17/22
- JMP 17.0 EA8 – 5/3/22
- JMP 17.0 EA9 – 7/8/22
- JMP 17 Code Freeze – 7/20/22
- Please visit Confluence for a full list of JMP 16 and JMP 17 dates.
JMP Development Updates
- Please visit this page to view bug verification lists for JMP 17.0.
Product Management
- Dan:
- Planning for upcoming Product Management JMP 18 strategy meeting May 10-12.
- Wrote Do you know the JMP product themes? And published to Inside JMP. The article is a follow-up to the addition of the product themes added to the JMP Statistical Discovery LLC – Goals 2022 earlier this year.
- Meeting with Novozymes, Dieter and the Premier team to discuss the JMP Live roadmap. Received a demo of their python app hosted in apphub. Novozymes sees the value of JMP Live; however, they objected to our current Windows Task Scheduler workflow for regular report refresh. They are excited about our roadmap for server-side data refresh and scheduling using Query Builder. Their data is stored in PostgreSQL, so there is a good match there.
- Continued work on pricing and packaging for 2022 and beyond; impact analysis using data from GIDB for several different pricing proposals.
- Bryan F: Worked with Michael Goff and Justin Chilton on collecting and interpreting design feedback for publish on client and data refresh scheduler from the JMP Live team. We also worked together to redesign the refresh schedule dialog. Met with Angelita Nitti(thanks, Angelita!) about how to use MemoQ to review strings. Created new JMP splash screens that respect JMP Creative Brand Guide specifications. Submitted icons for notes and captured windows images for Workflow Builder. Worked with Eric Hill to select a Material Design icon for JMP Live spaces. Prepared a PowerPoint slide for Sara Doudt that has the JMP Product theme icons I created. Conducted internal and external polls about the inconsistency in correlation colors used in the Multivariate Platform. Worked Landra Cunningham on copyright information for JMP Statistical Discovery LLC and updated documentation style guide with information about copyrights within JMP. Updated request for legal to review the use of Material Design icons. Presented some of the features I added to HTML5 for JMP 17 at the dev meeting.
- UX Workstream
- Functional UX Workstream: Reviewed ideas from brainstorming sessions on how to improve the bivariate platform and took critical feedback. Intend to process feedback, deconflict ideas, and submit ideas to a vote.
- Presentation Layer Workstream: Group met and agreed to move forward with the general idea to run a preference study as suggested by James, Karen, and Laura Castro-Schilo.
- Developer Process Workstream: Met twice with Mark Bailey and Laura Lancaster to further evolve ideas about MSA Design. Presented several design ideas.
Technical Support
- Duane: TS continues with our migration to Service Cloud. This week, we’ve been managing existing Sirius tracks as well as new Service Cloud cases. Juggling between the two has been a bit turbulent, but we are managing and our (Sirius) track volume will eventually drop to close to zero. I don’t have any reports available for Service Cloud yet, but the legacy reports for tracks is still available. I am meeting with folks next week to start getting the data for future reports. Here are the ‘legacy’ reports: TS JMP Live reports. (JMP Live 16) Here is information regarding Jira tickets opened by Tech Support.
- This week the JMP TS team celebrated the arrival of Ela (Eleanor) Reyes Giuliano, born 10Apr2022! Patrick, his wife JeAnne, and Ela are doing well! Here are some baby pictures that Duane shared. Congratulations on the arrival of your little sweetheart, Patrick and JeAnne! She is just adorable.
Development Operations
- Jim: Verified several Jira tickets and reported numerous new ASSERT and UBSAN tickets. Continued to work on the mac OS JMP Clinical EA installer to get both the Clinical addin and the EA addin to function (load order, permissions?).
- Myron: Worked with Melanie on JMPTOOL-429: problems with the stringbot run and JMP.xlf. Fixing some of the help build jobs on help-pdf-builds. Working on the crash system integration into Salesforce.
- Shannon: Researched 16.X crash with help from Dave B (JMP-12269: Crash with TrellisVariable::getNestedTerm in 16.X). Entered a tracking issue for a tooltip related crash that happens when JMP is run on the current Windows 11 Insider Build. Bobby, John Schroedl and Hunter investigated this issue which has been reported by several customers at Microsoft and other customers who participate in Insider Build testing (JMP-12214). Triaged anonymous crashes and met with SalesForce team about ServiceCloud and crash system integration.
Localization
- Angelita: Test kits for Discovering JMP; JMP Live L10n Workflow documentation edits; misc Jira cleanup.
- Howard: Updates to Jenkins jobs; reviewed over JMP Live documentation.
- Melanie: Worked with Myron to resolve Stringbot issue; testing Jenkins jobs; DJ prep work
- Sandy: Attended JMP Class: A Case Study Approach to Data Exploration Course; more memoQ training; JMPTOOL-422, JMPTOOL-22.
- Trish: Translation queries; coordinating doc handoffs; i18n Jiras; professional development workstream
- Updates to JMPLoc Project Jiras this week.
Documentation
- Qiana: Delivered Windows and macOS Menu Cards and Quick Reference Card to L10N. Worked with L10N on pre-testing of the Discovering JMP doc. Began the EA8 Help production process. Completed Situational Leadership prework. Attended Intern Manager Training and JMP Style Guide Discussion.
- Chris B: Updated the 16.1 help and pushed it public. Wrote a little dashboard to help us monitor the noindex settings and banners across all the versions of help.
- Susan C: Created Workflow Builder documentation, sent to Ernest for review, incorporated feedback and finalized content for DJ and UG books. Continuing to update existing tips of the day against 17. Created new 17 tip for the Preview panel and working on new 17 tip for animating a 3D scatterplot with an animated gif in the tip. Completed the JMP Live assessment to document and test user permissions and spaces per JMPDOC-1461. Thanks to Aurora for her all time and patience. Attended weekly UX meeting.
System/Host Testing-Cary
- Mandy: Workflow builder things. Lots of testing the UI and verifications, and the new packaging of WF’s; Wanting to write a few more tests, that do multiple includes and imports and groupings, but sort of keep hitting JIRA’s that need addressing first; Working with several of the new TS tracks to track down issues – crashes and all; I chased down a few this week and repeated them so that was good.
- Mia sent out a request for feedback about how folks might use WFB and the answers so far in 24 hours are amazing! It will be a powerful feature for 17! I personally like it so far for clean up tasks and the things that you tend to repeat with your data over and over.
- Nick: Continuing bug verifications, adding the appropriate image and jsl tests where needed. Fixed a bug with the JSL Unit Test GUI related to text subset files which contained duplicates or extra white spacing. Working with Justin on a code review for converting a number of C++ unit tests to the JSL UT framework as part of an ongoing project. Made some adjustments and baseline result additions to JMP Search unit tests that I have been running locally on Mac and Windows in preparation for adding them to baseline in the framework soon. Working on new functionality for the JSL Unit Test runner that will allow you to use a custom file list as a filter in the GUI. This should allow users to more easily run a specific selection of tests from a variety of folders.
- Hunter: Reviewed the Quick Reference Card PDF and verified updates, investigated several EA 7 tracks and opened new JIRA items, applied Monterey 12.4 beta 3 on host Macs in lab and ran some tests, and defect verification.
- Lisa G: Verified and added a test for a crash with nested axes and an empty table, investigated EA reports, and updated publishing syntax on the Crashes Without Defects report.
- Audrey: Met with Rachel in JMP Legal to clarify the needs and timing of our changing copyrights and attributions, update VMs for testing, work with Daniel P on testing the AWS server associated with JMP’s Check for Updates, preparing for JMP interns.
- Mike M: More work porting Sikuli environment from Azure to AWS (thanks to Josh for much help!!). AWS is slower and has more latency. Having to redo some tests to make them more robust (removing potential race conditions with Sikuli, Jython, Python and JMP all running at once). Opened an HTML bug wit Histograms and Multiple Response columns. Fixed bunch of imageTests that were out of date wrt the SAMPLE_DATA updates for columns _now_ named “# Employees”. Worked with David Barbour to add some unstable image files to the imageDiff area.
System/Host Testing-Beijing
- Beijing Team: JMP 17 I18N testing is in progress. Da and Mike are working on the 3rd round testing (Query time frame is 04/01/2022~04/27/2022). Details please find in JMPTESTBJ-1015.
- Eric Wang: (1) Testing new JMP Live JSL object ‘JMP Live content’. Added unit tests for creating JMP Live content. Updated JSL common functions to use JMP Live content for publishing, the old ‘web report’ way is deprecated. Updated JSL unit tests that use the old ‘web report’ way. Updated End-to-End tests. (2) Testing Jira related to JSL changes. (3) Bug verification.
- Da Li: (1) Manage and assign 3rd round JMP 17.0 I18N testing tasks. (2) Executed JMP 17.0 I18N testing and verified related bugs. (3) Test and verify JMP Live bugs for changes: New dark mode switch under nav bar, Change to download data table instead of download project for data table viewer page.
- Mike Wu: (1) JMP 17.0 desktop bugs regression testing. (2) 2. JMP 17.0 new feature testing of the AWS activation JMP update page against dev server https://d22e0fr583g014.cloudfront.net/jmpupdate.html completed, 3 bugs entered - JMPTESTBJ-1530 (3) 3. JMP 17.0 Query Builder/Open Database with ODBC connection regression testing due to the change "Replace DBCcontext reference counting with smart pointers" completed, 6 bugs entered - JMPTESTBJ-1532.
- Kimi: (1) JMP Desktop bug verification. (2) Test and verify JMP Live Jira items related “assigning credentials” and “Downloads prohibited” . (3) Testing JMP Live new feature [WEBJMP-4582] Front end work for adding stored credentials in Refresh Settings. (4) Integrated JMP Live E2E tests to Jenkins.
- Nala: (1) Prepare JMP Live I18N testing and JMP Live scenario-based testing. (2) Test Jira items related JMP Publish, Save Preferences.
Data Discovery
- Dave B: Researching and trying to create test cases a couple of crashes sent in by customers (project saving, query builder, nested axis), fixed a couple of ub asserts.
- Sibusiso: Attended JMP Training. I took the course JMP A Case Study Approach to Data Exploration over 2 days. Currently making progress on two JMP Issues, one on fixing the positioning of HierBox with varying entries and the other on having the right box selected in a Mosaic Plot whose axis have been moved.
DOE
- Brad: Got a positive response from the Journal of Quality Technology about the paper with Chris Nachtsheim and Ryan Lekivetz on a new class of designs for screening with mixed level (2 and 3 level) factors. Revision for complete acceptance should be easy. One reviewer wrote, "I love this article."
- Caleb: Attended DATAWorks in Alexandria, VA. Got to reconnect with a few people and make some new connections! A lot of good talks too, especially on ideas for helping the defense community be more open to sharing and collaborating with their data within their organizations.
- Joseph: Continued work on Easy DOE, including working on LIRT menu options, and state transition and more variable importance work for Easy DOE Profiler (i.e. Predict tab). Also, miscellaneous bug fixes and string work.
Host
- Aaron: Worked on digging out my inbox after having been out sick for a week. (Please let me know if you’re still waiting on something from last week and I haven’t gotten back to you yet). Finished setting up my new windows machine; I can now build JMP in ten minutes instead of thirty! Fixed project crashes identified by John Schroedl and Dave Barbour. Fixed clipboard accelerator keys in WinHost’s WebPageDisplay. Fixed crash when closing windows on windows that I accidentally introduced with my WebPageDisplay fix. Wrote throttledAsyncMap, a working alternative to throttledPromiseAll for JMP Live database operations on large lists of objects.
- John Schroedl: Chris H., Brian C. and I switched the production help redirect and crash upload servers from SAS machines to AWS. Investigated crash issue related to projects on an unreliable network connection. Exploring migration of managed host code to .NET 6 as .NET Framework is end-of-life and in maintenance mode; a change to consider for early JMP 18 as we also investigate using WinUI.
- Daniel P: Audrey, Bob, Nan and I have progressed to the TEST environment with the new JMP Update server!
- Michael H: Working on improvements to Mac Leaks reporting.
HTML5
- Josh M: Fixed JMPHTML-1570: X axes and other associated objects shift up – fixed a regression caused by changes in JMP that was blocking my ability to demo in JMP Live. Prepared for Thursday Dev Meeting demo of Categorical Profilers in JMP 17.
- Paul S: Resolved various interactive HTML issues:
- JMPHTML-1383 Treemap now format Color and Size label formats correctly
- JMPHTML-1589 Treemap Group label colors, background, borders now supported
- JMPHTML-1441 Tooltip for date/time ranges now correctly display
- JMPHTML-896 - Sentiment Analysis now properly exports row states
- JMPHTML-1607 Treemap above group labels have proper font size
- JMPHTML-1506 Histograms now support overlap factor
JMP Live
- Aurora: For the publish-on-client feature, added support for querying data posts (apart from any other kind of post), and fixed a bug which reported on replaceable posts inaccurately in an edge case. Added notifications to users when they gain or lose access to a space. Updated deletion of non-empty folders to send more useful information to the client. Updated rules regarding how moderation of a folder affects the contents inside.
- Josh M: Addressed WEBJMP-4879: Allow data viewer sidebar to apply column selection to grid.
Statistics
- John Sall: In the Profiler a new mechanism allows it to better identify a Standard Error formula column and determine which predictor to associate it with. (JMP-12217) In Model Screening, the Decision Threshold did not work correctly with k-fold and related methods, so this has been reorganized to operate on probabilities averaged over folds. (JMP-12105) The Profiler will not automatically expand formulas with intermediate formula columns when marked with the "Expand Intermediates" column property. This means that profiling Neural predictions and Logistic fitted probability formula columns will no longer need the "Expand" option checked at launch. (JMP-12259)
- Peng: While in bug-fixing mode, resolved these notable issues: JMP-10690: Deleting rows causes JMP to crash, JMP-10603: Stability report with 0 in inverse predictions, and JMP-12130 Custom Sigma Relationship model violates nested model assumptions. Resolved some UBSAN issues.
- Laura C-S: Fixed a tough bug with the Predicted Values’ Plot in SEM, which was leading to incorrect pairing of row states with data points and, in some instances, was also causing a crash. Fixed other minor issues in SEM too. Continued working on JMP Dev presentation.
- Annie: Fixing the UBSAN issues for control charts, along with fixing general Jira issues in both CCB and EWMA.
Stat Documentation
- Karen: Worked on updating the DOE MSA chapter this week.
- Michael C: Sent all 4 Fit Y by X chapters out for review, following a rewrite effort in 17.0; started working on documentation for Repeated Measures Degradation platform.
Stat Testing
- Tonya: We switched from SIRIUS to Salesforce for beta feedback. I have not learned how to create reports in Salesforce so there will be no beta updates for a while. I’ve been working on learning Salesforce, testing the NF of N Subgroups in CCB added to Limit Summary tables, cleaning up legacy beta data so that comparisons can be made. I also answered a user community question about changing limits in control charts, answered a customer question about the differences between CCB and the legacy XBar charts, and did bug verification.
- Jacob: Testing Units for factors and responses in DOE. Reviewing DOE documentation. Adding performance tests for JMP 17 improvements with wide data and investigating potential performance issues. Testing Automated Data Imputation and updating unit tests. Investigating unit test failures.
- Mark: Designing Easy DOE with Brad and Joseph. Testing Easy DOE with Jacob. Finished unit tests for Passing-Bablok regression in Bivariate, Bland-Altman analysis in Matched Pairs, and Profilers in Bivariate. Worked on alternative UI for MSA Design with Bryan Fricke and Laura Lancaster. Assisted Joseph Reese with customer request for analysis of ALT. Responded to questions in JMP Community.
Note from Shannon
Thanks very much to Chris Gotwalt for contributing this comic! Hope you all have a wonderful weekend!
