Reminder: Please set the Release Notes Affected field to Yes for items that should be documented in our maintenance release notes. Our writers use this field to track which Jira issues need to be shared with customers. It is also extremely helpful to writers if you can include draft text that describes your change in the Jira comments.
Welcome to the JMP Development Update for November 1, 2024!
Hope you all enjoyed your Halloween evening last night! Tomorrow is the last day of early voting in North Carolina. For more details about voting options, please see the end of the update.
This week Paul Nelson identified a critical update to JMP’s embedded Python files that must be made in all active release tracks, including JMP 19 EA4 and 18.1.1. Bob and Jim are working with Paul on code signatures and installers as Python file updates are finalized for Windows and Mac. We expect that testing work on a rebuilt EA4 will pick up again next week. So far in testing the previous iteration of the installers, no showstoppers have been found.
Once updated Python versions are updated in the 18.1.1 track for Mac and Windows, final installer candidates will be created for this dot-dot release. Another fix was pushed to 18.1.1 this week to resolve a CRP problem with Tabulate performance for some scenarios. Thanks to everyone on the development, testing, and devops teams for helping get 18.1.1 changes ready to go!
Brian Corcoran asks us to join him in congratulating Chris Humphrey on the occasion of his 10th anniversary on November 3rd! He knows Chris will be recognized along with JMP’s other November anniversaries and new hires on Inside JMP, but he asked to give Chris a special shoutout here too! Brian says that Chris is an ideal mentor, developer and teammate. Chris started working at JMP on JMP Graph Builder for iPad and has done great work on the Mac, JMP Live and JMP Runner for the Mac over the years. Happy 10th anniversary, Chris!
Finally, thanks to Tonya Mauldin for sharing the beta/crash report for the last two weeks with crashes selected!
https://jmplivedaily.dev.jmp.com:3501/packages/F042V6wsbZSfshWv1XFxM
General Announcements
Important Upcoming Dates
- JMP 18.1.1 Security Freeze – early next week (extended to accommodate required Python 3.11.10 security fixes)
- JMP 18.1.1 Final Image Candidate – ~11/4/24
- JMP 18.1.1 QA Signoff – 11/14/24
- JMP 18.1.1 Release in MyJMP - ~11/19/2024
- Please visit Confluence for a full list of JMP 18 and JMP 19 dates.
JMP Development Updates
System/Host Testing-Cary
- Audrey: EA4 Testing, preparing for 18.1.1 testing. Continuing to review the partitioning of our unit tests into three equal run-length segments, which should help our unit test framework complete much more quickly once we have the Parallelization of the unit tests in place. There is a lot of great work happening toward that goal (shoutout to Nick Ruva and Jim Borek). Below, the graph shows the total time each of our three streams takes. When we’re running tests in 3 parallel streams, the entire stream will be done in about 4 hours (instead of the 12+ hours it takes now while tests running serially).
- Nick H: Found and filed a few bugs including a couple for Notebooks related to the new drag and drop reorder functionality: being unable to drag a block into the first position and undo/redo not capturing reordering of blocks. Another bug filed was related to passing a function callback into _init_ that was causing a crash in JSL Classes. Spent some time trying to clean up unit test failures in the nightly runs, filing a jira for a classes test failure that I am unable to rep locally, and continued ongoing work with 19.0 verifications. I will be working with Mike M. in the coming weeks to get the JSL testing framework working with the new mimic tests that are in progress.
- Hunter: Started JMP 19 EA 4 testing and responded to one JMP 19 EA 3 case. Investigated crashes and updated related JIRA items. Worked with Daniel P. with an issue getting my updated expiration dates for JMP Student Edition to work. Updated to Sequoia 15.1 on the host testing Macs in the lab and ran tests. Reviewed more localized documentation PDF files.
- Lisa: Started EA4 testing, verified header graph fix, and entered a few bug reports when using the Parallel Y Axes platform preferences.
Web Testing – Cary
- Natalie: Completed all updates to the HTML Automation testcases for the existing V19 UI changes. Our daily runs are now basically clean. Continued to add new test coverage for Fit to Window turned on. Starting new coverage for Control Chart. Updating our Confluence pages to track automation progress.
System/Host Testing-Beijing
- Da Li: (1) Bug verification, add corresponding UT. (2) Create 2 new bugs during bugs verification. (3) IN-Progress: JMP 19.0 EA4 testing, 2 bugs created.
- Nan Wu: (1) JMP 19.0 bugs regression testing. (2) Investigation on the 8 Oracle unit test failures due to Oracle client side charset configuration, discussion with Jim and Jim helped configured the nightly run Windows machines to add the NLS_LANG Environment Variable for Oracle, the I updated the unit tests accordingly. (3) Discussion with Audrey on how to handle the SQL unit tests due to the Oracle DNC issues investigation, and the final decision is to remove the split distinct tests for each ODBC driver, and just keep the old ones to track the regression unit tests that cover all the ODBC drivers in one test for corresponding feature. (4) Escalated the potential risky issue to Audrey that about JMP Live refresh data failed with S3 and SharePoint data connector published table, and entered bug to track the issue: WEBJMP-9350. Also created 2 confluence pages How to make connection for AWS S3 data connector and How to make connection for SharePoint data connector (5) Investigation on the nightly run unit test timeout issue for one Windows server, it turned out to be the DB2 ODBC driver is not correctly install on that machine, provided the investigation feedback in jira: (JMPTEST-1385: and also created a confluence instruction page: How+to+remove+the+DB2+ODBC+driver+if+it+got+corrupted. (6) Investigation and provided feedback on another unit test DNC issue, and updated the test accordingly to fix the DNC issue: JMPTEST-1454. (7) JMP 19.0 EA 4 testing started - JMPTESTBJ-3188.
- Kimi: (1) Bug verification. (2) JMP 19.0 EA4 Testing, details refer to JMPTESTBJ-3188 – In Progress. (3) Update the password for brdstg for all the UTs - Done. (4) Debug UT DNC/Failures for Python 18.2 and 18.1.1 on windows – cannot reproduce: Create a jira to track this issue (JMPTEST-1453). Sent Email to Jim, Bob and Paul about the failures, to see if they know the changes on window with JMP 18.x. (5) Data Viewer – NF: (WEBJMP-9289: Show column groups in data viewer – In Progress. (6) CCW – NF: (JMPTESTBJ-3159: Sanity check various JMP report types for JMP Live CCW compatibility – In Progress. (WEBJMP-8781: Support view and download of triage history for one marker (front end) – In Progress. (WEBJMP-8963: Generate custom download file for triage history of one marker – Done. (WEBJMP-9086: Use explicit GraphQL query / REST API route for history of single control chart marker - Done. (WEBJMP-9203: Clarify group "wants_warnings" related names and descriptions - Done. (7) Jenkins: Check results for Beijing Daily UT. Run load testing for both 18.2 and 19.0 monthly, details refer to JMPTESTBJ-3180 – Done. Generate new license for all the Jenkins test machines, details refer to JMPTESTBJ-3186 – Testing. Change the password for brdstg, details refer to JMPTESTBJ-3190 – Testing.
- Da Zhang: (1) Bug verification. (2) Sanity check various JMP report types for JMP Live CCW compatibility – JMPTESTBJ-3159 – IN PROGRESS. (3) JMP Live E2E/compatibility failures investigation – JMPTESTBJ-3178/JMPTESTBJ-3182/JMPTESTBJ-3189 – DONE. (4) JMP 19.0 EA4 installer testing JMPTESTBJ-3188 – IN PROGRESS.
- Lily Meng: (1) Review past Jira tickets related to Samples - Data, Samples - Scripts, Samples - Other, Samples - l10n - Done: Understand historical issues. Focus points for understanding issues related to components. (2) JMP 19.0 EA 4 testing - In Progress. (3) Learning the remaining JSL content - Done.
- Nala: (1) Bug Verification. (2) JMP Clinical 19 EA4 Installer Testing - in progress. (3) Investigated JMPTEST-1418 (4) Transferred new projects to Lily. (5) Learn Matlab feature. (6) Updated brdstg’s password in automation tests – Done.
Core
- Dave B: Pushed a first round of changes to make add-in builder prefer referring to internal files. Fixing bugs in add-in builder I have found while modifying it. Xan and Mike M noticed that the history of image diffs was misleading if images had not been created recently so I fixed that. Added the option to have Graphics Scripts render in the second render pass when segs are drawing selected elements. Updated the Crosshairs tool so it will show all Y values for parallel graphs.
- Dan S: Enabled stretching of the data filter from JSL and in the Filtered Tables. Fixed min/max support for CalendarBox, and apply the min/max values when the calendar is used with NumberEditBox. Fixed a problem with the size of the Platform Preset icon. Fixed a focus issue in TabList that made it difficult to switch tabs.
- Morgan: Added a toolbar and new toolbar items for notebooks. Added drag/drop for notebooks. Added edit action listening to notebooks. Implemented copy/paste in notebooks.
- Xan: Started new feature so transform columns can be dependent on the data filter and Graph Builder grouping.
DOE and Reliability
- Caleb: Worked on a few sample size explorer bugs and further development on CSALT. I also made substantial progress on an explorer version of single acceptance sampling based on user feedback from Discovery.
Hosting and Interfaces
- Paul N: Finishing up with JMP-23620 – using portable data frame protocol instead of CSV when doing JSL Python Get( data_frame ). Addressing JMP-23662 by working on a Security update of Python from 3.11.9 ( the last supported binary release by Python.org ) to 3.11.10, the first security patch that is source code only. This update resolves Critical and High vulnerabilities. Was not detected by our Snyk scanning, but just before Discovery, an Elite customer inquired about this update. Building Python from source on Windows, pushed to 18.1.1, 18.2, 19.0, and 19.0 EA branches. Working on getting equivalent distribution build completed on macOS – x86_64 and Apple Silicon.
- John Schroedl: Made lots of updates related to dark mode and overall UI functionality in anticipation of EA4. Improved quarantine dialog when dealing with read-only files.
Interactive HTML
- Mike Stickles: Moved my work on JMPHTML-1407 (Legend setting on size role does not work on HTML5) to related issue JMPHTML-13685 (Legend for graph with Size role doesn’t match JMP); the original issue included that plus marker sizing issues so I updated 1407 to only be the marker sizing and 13685 to be the legend work. All work has been pushed to Swarm for (hopefully) final review. Have returned to working on JMPHTML-13966 (Word Cloud selections not working correctly) and JMPHTML-13982 (Implement selection capability in Text Explorer term lists) which should complete implementation of Word Clouds in HTML5. Completed ACT-Now Compliance Training.
- Paul Spychala: I have joined John Powell, in development of 3D Scatterplot in HTML, with the first contribution of using the exported axis and scale specifications in HTML (JMPHTML-14141). Also fixing several bugs and issues with Fit to Window where several components didn’t stretch properly (JMPHTML-14165, JMPHTML-14180, JMPHTML-14120), and Profiler visual bugs (JMPHTML-14181, JMPHTML-14164).
- Praveena: Worked on Support for deselection within report for CCW, Handle hidden warning selection from the warnings panel, Special handling for Process Screening in Interactive HTML Export and Save As Interactive HTML, and Process Screening- For the control chart reports loaded when user select a process, the report crashes when the user pans the axis. Started work on capturing performance benchmarking for exported process screening reports.
JMP Live
- Aurora: Control chart warning improvements (keep invalidated markers in the database, guard against certain actions by anonymous visitors, translate downloaded warning files). Third party package updates. Helped with GitKraken license renewal for 2025.
Statistics
- Laura C-S: Participated in the SAS and NCSHP panel for high school students, met with the DEI Metrics committee, interviewed a grad student who applied for a summer internship, met with Tom Donelly to discuss DATAWorks conference and sent him a proposal for a SEM mini-tutorial. Followed up with two customers from Discovery to share SEM-related resources. Completed latest ACT-Now training. Fixed a bug with the means of latent variables in MIIV-2SLS, and started investigating another bug.
Stat Documentation
- Michael C: Fixed some broken cross-references in some of the FLM chapters, worked on updates to the Scripting Index entries for Standard Least Squares, planning for upcoming projects.
Stat Testing
- Jacob: Analyzing results of Easy DOE usability study from Discovery with Mark Bailey. Testing a shelved build of a new Sample Size Explorer Caleb is working on, Acceptance Single Sampling. Investigating unit test failures and verifying Jira tickets.
- Tonya: Working on bug verification and updating unit tests.
Life Sciences Updates
- Wenjun: Presented AI for auto text classification by JMP Pro published in Frontier in Artificial Intelligence (https://doi.org/10.3389/frai.2024.1401810) at the MAQC annual conference in Xitang, China last week. The impressive screen showed the PPT plus the captions for both English and Chinese simultaneously as generated by AI while we were talking. Some captions were a little funny in both English and Chinese though!
- Drew: Participated in a very fruitful Discovery! Lots of great customer interactions, and I am told some new JMP Clinical sales! Continued feature/bug-fix work on JMP Clinical 18.2 and 19. Worked with tech support to assist Amgen in upgrade of JMP Clinical 7.1 to 18.1.
- Richard: Finished up testing/final steps for UNC student add-ins for JMP Marketplace, UpSet plot and Forest plot. Gave a talk on the importance of data visualization for communication at the UNC Department of Biostatistics.
Technical Support and Engagement
- Wendy:
- Discovery week was an awesome week for the Support team! This was the first Discovery for several team members. The Tech Support pedestal was staffed by statisticians, systems specialists, and engagement specialists who fielded questions from ODBC, Graph Builder, projects, scripts, and more. It’s always energizing to be at Discovery!
- The Engagement team would like to extend a special thanks this week to Daniel Powell for his quick help with an RPS issue.
Technical Support Case Volume by week:
Case Topics for Technical Support queue, last week:
Engagement Support Case Volume by week:
Case Topics for Engagement queue, last week:
Development Operations
- Shannon L: User support for Atlassian products - helping with Jira best practices; released improvements to the R&D Feature Request workflow in Jira. Dev meetings on Builds and StringBot migration. Attended All Things Open - an annual fall conference in Raleigh which focuses not only on current industry open source topics but other new software technologies and best practices. Completed product export registration for our 18.1.1 releases.
- Bob: Final translated strings for installers related to uninstall of previous EA. Thanks Trish! (JMPTOOL-1363) Created product readiness page in Confluence for software signoff. Confirmed with Legal that the Student Edition can use the standard click through license agreement in software installers (JMP 23517). Digitally signed python files with 3.11.10 fix for 18.1.1, 18.2, main, EA (JMP-23662).
- Melanie: Continued work on Daily Unit Test logging improvements: regularized current console log search strings to trigger failures, added new search strings, improving performance of script to grab Jenkins data. Added Jiras for 18.1.2 branching tasks. Continued work with Myron on migrating Stringbot to AWS (almost ready to go!)
- Jim: Working through Python updates for JMP 18.X and 19.0 (including EA4) with Paul N and Bob. Unit test troubleshooting and collaboration with testers to resolve test failures on specific configurations.
- Myron: Updated doc team VM (JMPDOC-2289). Finished setting up jmptoolprod to run stringbot (JMPTOOL-1183). Started VM update (JMPDOC-2286).
- Shannon C: Attended various group meetings, had discussions on terminology consistency across the product and web pages, and continued troubleshooting work with testers to resolve unit test failures.
Localization
- Allison: Worked with vendors on getting quotes for V19 JMP Software localization and submitted PO requests. Validated and finalized localized 18.0 and 18.1 Documentation pdfs and handed off to QA for testing; prepared for handing off 18.0 and 18.1 localized Documentation pdfs to Doc team for Documentation Library creation. Finalized and handed off localized 18.2 JMP Live UI and Installer strings; handed off localized 18.0 Documentation pdfs to Marketing.
- Trish: Working with Allison on quotes for V19 localization work. PM tasks associated with JMP Documentation Library. Following up with developers on string cleanup work. Localized files to build JMP Live help for 18.2 delivered to Documentation team.
- Sandy: Finishing up commit job automation of new source to P4. Testing of image diff file comparison.
Documentation
- Devon: JMPLOC-6781: Fixed a minor snag on Title Page and Text Inset labels from 18.1, squashing bugs in ZH conversion, drafting a Confluence page on using FM2DITA to convert structured FM to DITA XML, continued JSL course, continued reading Global English Style Guide.
- Susan C: Working on 18.2 JMP Live help for EN and all languages. Working on some retrospective JMP Live fixes and ironing out process. Updating 18.1.1 RNs. Finished up review of non-stat strings for October. Reviewed a bug for Khawar that impacted the EG.
- ChrisB: Reviewed 18.2 and 19.0 strings. Fixed the PDF tables of contents in source at 19, and manually in the PDFs at 18.1. Recreated the 18.1 Doc Library PDF and the Doc add-in. Started fixing the script that creates the sitemap.
- Khawar: Sample Index: Divided the issues into 5 major categories; will create a Confluence page for each to gather feedback. Essential Graphing: Addressed all the open Jiras; Resolved the issues and reached out to testers.
- Qiana: Work on the User Content Mapping Project. Jira work. Project planning and coordination.
Note from Shannon
Remember, if you have not yet taken advantage of early voting here in NC, you can still visit an early voting site tomorrow - Saturday 11/2/24. Be sure to bring a valid photo ID (you can find details here about valid ID types).
And if you are eligible to vote in NC and are not yet registered, you can take advantage of same-day registration tomorrow at an early voting site. Same-day voter registration is not available on Election Day. If you miss early voting and are already registered to vote, you can do so on Tuesday 11/5/24. Please vote!
