All information is SAS company confidential. Do not disclose.
Welcome to the JMP Development Update for June 25, 2021!
Congratulations to JMP’s own 2021 SAS CEO Award of Excellence winner Dr. Julian Parris! It is wonderful to see Julian recognized for his longtime dedication to the JMP products and division. Julian has been a strong advocate for the use of JMP in teaching in his prior role as a JMP Academic Ambassador. In his current position as the manager of the Strategic Initiatives & Analytics group, Julian was responsible for writing and producing the very successful JMP On Air learning series-for our customers and for us-early in the pandemic. Please congratulate Julian, and if you’d like, you can do so in the comments of this Inside JMP article. You can find the list of all CEO Award winners for this year in this article on Inside SAS.
We are getting close to the end of the JMP 16.1 cycle with installer validations just around the corner. In addition to identifying important fixes for 16.2, teams are spending most of their time researching and developing JMP 17 features.
Thanks to everyone in JMP development and JMP product management for collaborating to get JMP 17 EA1 ready for to the 200+ customers who have already signed up for the program! It is fantastic to see feedback and bug reports already coming in from customers this week. If you’re interested in seeing what’s being highlighted for this first EA, please visit this Confluence page prepared by Mia to get the details.
As you plan ahead for what you’d like to highlight for JMP 17 EA2, please keep your feature pages in Confluence up to date. We’ll be cutting EA2 in early August and I’m sure we’ll have plenty of new and improved items to share with customers. Also, please let me know if you have something you’d like to demo at an upcoming dev meeting! I have dates open in July and August if you’d like to put a placeholder on the calendar to share your work.
This week’s JMP dev demo highlighted the new Equivalence testing features Jianfeng Ding has been adding for JMP 17. If you missed the meeting, you can see a recording here. Thanks very much to Jianfeng for sharing the technical details about this work and its importance for users! I was glad to see that in addition to the helpful comments and ideas received from internal users during the meeting, Jianfeng has already received an email from an EA customer sharing more suggestions and thoughts about this new feature.
Speaking of JMP 17 new features, Brian Corcoran asked me to make you all aware that JMP Live now supports Dark Mode for JMP 17. Bryan Fricke and Michael Goff have been working hard to make this major new feature a reality. The team would love to get some early testing and feedback and I know we have some Dark Mode fans out there!
Michael G shared the following details about this undertaking: “Last week Bryan Fricke pushed out a change that adds an official way to turn on Dark Mode in JMP Live. HTML5 reports published or regenerated after the change should switch to use the preferred visual theme when opened. When you log into a 17.0 instance of JMP Live you can hit your profile icon and go to Settings > Preferences to enable it. We are continuing to find and fix visual bugs with dark mode so please send any issues to me to investigate.”
I would also like to call attention to another feature that was very recently enabled in JMP 17. Evan McCorkle and John Schroedl collaborated to add a log file to the set of crash details sent to the JMP crash server by JMP 17. This log contains a list of interactive actions completed prior to a JMP crash. We hope that this information will help provide valuable clues about what happened in JMP before a crash, and give those of us who research crashes an additional data source for finding commonalities between crashes with similar stack traces.
The JSL crash log feature is currently enabled only for JMP 17 internal JMP builds. If you use JMP daily builds, please reinstall using the latest installer to make sure that you have this feature enabled when submitting your JMP 17 crashes. Thank you!
Thanks to Tonya for sharing this week’s beta/crash/telemetry tracks for this week with crashes selected. Thanks to all for helping track down crashes early in the 17 cycle!
Product Release
Topic
Subtopic
Platform
Company
General Announcements
- Welcome to new JMP developer Andrew Vitkus! Andrew recently joined Xan’s group and has started to work on a few projects already as he gets familiar with the JMP code base-working on adding support for variable charset support when reading zip files and single sided error bars.
Important Upcoming Dates
- JMP 16.1 Final Installer Candidate – 6/30/21
- JMP 17.0 EA2 – 8/3/21
- Please visit Confluence for a full list of JMP 16 and JMP 17 dates.
JMP Development Updates
Data Discovery
- Xan: Jira triage and Graph Builder presentation for Southern California JMP Users Group.
- Dave B: Investigating a variety of crashes, updated plotcol to support an axis below the column
DOE
- Caleb: Merged a few bug fixes for my Builtins into 16.2. Working on a prototype for Type I MSA design (to support Laura Lancaster’s new platform) and a revised workflow for ALT design. Inspired by Jienfang’s dev talk, I’ve also begun adding non-inferiority and superiority tests to the Equivalence Power Explorers.
- Joseph: Continued work on the Easy DOE UI and infrastructure and further refinement of the prototype.
- Brad: Working on a document describing a prototype of a new DOE tool called EZDOE.
Host
- Paul T: Added OSIPI import functionality (under File > Database > Import from OSIsoft PI Server…) – still a work in progress.
- John Schroedl: Pushed Call Dll crash fix to 16.1. Found fix for Intel Xe graphics card issue. Updated CrashReader to show JSL log uploads. Met with Jeremy Booker and others to discuss future move of crash and help servers off old systems. Keeping up with Windows 11 news.
- Paul N:
- Improved locating of Python on macOS for Python.org installations of Python. Helped Jim with the Python installation on Apple Silicon machines. The default Python download from Python.org contains only Intel binaries. There is a separate download link for universal2 install with both Intel and ARM binaries.
- Responded to a request by the software security people to run an additional report from BlackDuck on open source usage in JMP. Updated libCurl from 7.76.1 to 7.77.0 as 3 CVE vulnerabilities had been detected in 7.76.1. The curl update has been made in JMP 16.2 and 17.0. Blackduck triage; some of the SAS jar files were misidentified. Investigated a couple reported leaks from the leaks checker. Reviewed our open source usage and the disclaimers that we present in the credits and documentation.
- Created a backup of the activation production activation database. I will load the production database in my development environment so I can validate my backup and test the removal of unused columns. We have carried along all of the columns from the original Globalware activation database. The database now contains 2.5M rows. Pruning unused columns will save space and could improve performance. Investigating creating a backup activation environment on AWS.
HTML5
- John Powell: Interviewed a candidate for our JavaScript Developer position. Answered a question about HTML5 local data filters on the JMP Community. Discussed how differences between Mac and Windows default font sizes will impact JMP Live now that HTML5 supports more font sizes (JMPHTML-837). Working on re-implementing HTML5 LDF Inversion to match desktop- Part 3 - Updates for JMP Live (JMPHTML-821). Display categorical color role in Bar tooltips and Bubble tooltips (JMPHTML-915, JMPHTML-888). Removed isConsistentRendering flag from JavaScript code (JMPHTML-948). Fixed format of “0” in heatmap labels (JMPHTML-967). Detect new statistic Coefficient of Variation(CV), render static and log message (JMPHTML-968). Investigated issues with HTML5 build. Prepared for end of HTML5 Sprint 3 meetings.
- Mayowa: Worked on adding support for customized axis tick font color to Interactive html (JMPHTML-926), fixed a bug with axis grid lines (JMPHTML-883), and working on showing categorical color role in Boxplot tooltips (JMPHTML-964).
- Josh M: JMPHTML-963 – Display categorical color role in line tooltips. JMPHTML-677 - S1583036: Progress indication mostly missing when open large Interactive HTML in JMP Live
JMP Live
- Katherine Li: Went into the office and met a lot of the JMP Live team! Finished up fixing the bug on the JMP Live licensing communication and display error, submitted it for review and am working on updates.
- Aurora: For JMP Live Spaces, wrote more migration code, debugged process for restoring pre-migration database, added support for finding more spaces, more info on returned spaces, and sorting spaces. For JMP Live Access Control, using new access control mechanism in package list filters. Finished JSL training course.
- Josh M: Began design work for the Data Table Viewer (see Confluence page)
- Michael G: Continuing work on various Space related improvements on the JMP Live client.
- Brian C: Working on having the concept of a Default connection on JMP Live.
Statistics
- John Sall:
- Moved Process Screening from the Screening submenu to the Quality and Process submenu and grouped control chart items (S1589429).
- Added Decision Threshold support to Fit Nominal Logistic, Fit GenReg, Neural, Partition, Bootstrap Forest, Boosted Tree (S1584043).
- A preliminary set of Effect Sizes (eta^2 and omega^2) is now in the Fit Least Squares report Effect Tests, though hidden (use alt-right-click to unhide). More feedback needed to settle on a default (S0634433).
- The layout of Model Screening launch dialog is slightly improved. (JMP-3363)
- K-Means Clustering is faster for very wide problems--by loop short-cutting. (JMP-3352).
- Hierarchical Clustering is faster for large problems - it no longer uses an SVD, and it turns out that SVD really didn't help enough to overcome its expense. (JMP-3316)
- Fit Response Screening has new options to control which plots to show (S1589385).
- Annie: Added Laney P’ and U’ Control Charts as a JMP 17 new feature to Control Chart Builder.
- Peng: Continued working for the China Discovery event: recorded and edited my presentation last week, and translated Chris’ talk this week. Continued working on the repeated measure degradation.
Stat Testing
- Fang: Testing and working on the unit tests for Fit Response Screening (S1589385) and SVEM (S1588838) in GenReg. Bug verification.
- Tonya: Cleaning up unit tests from recent report order changes made in Process Screening by John Sall, and recent QQ and PP Plot changes made in Distribution by Clay Barker. Answered user community questions about altering the shading colors in Process Capability and confidence intervals on QQ and PP Plots in Distribution. My blog post about the new features in Process Screening for JMP 16 was published: New features in Process Screening for JMP 16.
- Jeremy: James and I reviewed and resolved unit test failures due to performance improvements in MDS. Pushed a change to MDS that allows the data format to be detected automatically (no more having to remember to select attribute data). Improved some error messages in MDS. Worked on resolving a discrepancy between JSL and multivariate pairwise correlation computations. Now working on allowing the user to choose between different distance metric options when attribute data is provided to MDS (Manhattan, Tanimoto, etc.) Responding to positive and helpful feedback from Regeneron on equivalence testing.
Life Sciences Updates
- John C: Added functions to begin factoring out code for creating common JMP Clinical 17 report widgets, and making other improvements to Review Builder’s UI for sizing and execution.
Technical Support
- Duane:
- Many ‘thanks’ to John Schroedl for his attention to the Intel XE Graphics Issue. TS appreciates the time and effort put into this issue.
- As TS uses Jira for our Bug and Feature Requests, please let us know if we need to do things differently. I know we are all learning at the same time, but just let us know if you have suggestions.
- Here are the TS JMP Live reports. (JMP Live 16) and information regarding Customer Reported Defects filed by TS (legacy defects). Here is a similar Jira filter for TS-related items: TS Reported filter?
Development Operations
- Jim B: Created EA 1 installer for mac OS. Reported numerous ASAN and LEAKS problems as Jira tickets. Worked with Bob to rename mac OS JMP Subscription installers for 16.1 and 16.2 and place them into the WebReleases folder on JMPSRV01. Perforce support.
Documentation
- Sheila: Generated the localized JMP Live help. Tested FrameMaker 2020 and FrameScript 7. Worked on Jira issues.
System/Host Testing-Beijing
- Eric Wang: Updating JMPLiveJSL unit tests.
- Created a Jira story and few sub-tasks to track progress, BRDSTG-3142
- Updated tests for functions below (BRDSTG-3144, BRDSTG-3145
- Publishing report/folder
- Getting post(s) and folder(s)
- Getting child reports
- Report/folder object
- Paging of result list object
- HTTP request
- Post accessors
- ‘Add reports to folder()’ and ‘Replace()’ functions are being blocked by WEBJMP-3368
- JMP Live 17 has many new features. Some of them are completed and some are partly implemented (cannot be tested yet). Created a to-do list to document ideas for 17 new features testing. Anyone is welcome to add new ideas.
- Verify JIRA bugs
- Da Li: (1) Test JMP Live related functions when Dark theme is enabled on JMP Live. (2) Investigating JMP crash issue, see JMP-3323. (3) Verified JIRA bugs.
- Mike Wu: (1) Executing interactive regression testing for Query Builder in JMP 16.1. (2) JMP Clinical 8.0 HotFIX monthly check BRDSTG-3066 (3) JMP 16.1 OLE Automation testing with JMP Pro 16.1. (3) Tried the connection from Azure to SAS. Created How+to+Identify+port+number+of+SQL+server (4) Verify JIRA bugs.
- Kimi: (1) Learning JMP by following the Confluence page Learn+JMP . (2) Learning JMP JSL by following the Confluence page Learn+JSL .
- Nala: (1) Investigated FD tests failures in Jim's Debug environment. The reason for the failures is that Jim and I have different steps to install Debug build. (2) Testing JMP Live feature "Move Post", see WEBJMP-3280. (3) Trying the connection from Azure to SAS network for CAS, Databases, SAS. (4) Verify JIRA bugs
System/Host Testing-Cary
- Sara: Writing tests for Axis Settings using the new With Window Handler method.
- Lisa G: Started testing new CV summary statistic in graph builder, verified 17.0 defects/Jira issues, reported pie selection regression, and investigated one EA track regarding persistence of color gradient settings.
- Hui: Testing HTML5 Dark theme, Treemap, and display statistics on Categorical variables. Communicated with Bryan and John on testing problems. Reported 15 issues in JIRA.
- Mike M: Had a great CCB review mtg with Annie, added 3 more CCB Sikuli tests, opened JIRAs for: Crash for Chinese text exp w/ sentiment analysis, axis label issue w/ Prediction Profiler. Working through image diff noise. Investigated 2 tech support tracks, 1 is real issue with text box color messages.
- Mandy: Worked on several tech support tracks including a few crashes that I could replicate and opened Jira tickets to track. Did some more testing of Tables menu previews with stack, summary, subset, etc on large tables and timing seems appropriate. Worked on Jira filters and to resolve Jira tickets.
- Josh L: I now have 5 VMs running in Azure, 3 that are replacing some existing open stack deployments. I have updated my Windows Dev machine to build and run JMP 17 database migrations. Testing JMP 17.0 migrations and verifying groups are migrated to spaces.
- Cary / Beijing JMP Live Testing Jira Status Summary
- 05 Stories in Testing
- 23 Stories in Test Ready
- 11 Bugs Created in the last 7 days
- 29 Stories / Bugs Closed in the last 7 days
Note from Shannon
While looking at Michael G’s dark mode screen shots today, I noticed that he had a food report with a familiar looking cookie on its thumbnail. I mentioned the picture to Michael and he said that his family has been visiting New York Bagels and Deli for bagels and black and white cookies for almost 20 years! He and his wife even had them make a big black and white cookie for their wedding. This looks amazing!
I was glad to see what looked like buttercream frosting on the cookies in this picture. I’ve not been to the bakery Michael visits, but every other time I’ve seen vanilla-chocolate frosted cookies here in NC they just haven’t been like I remembered from my childhood…that is, until last weekend when I visited the Utica Bakery food truck in Apex to pick up some treats for Father’s Day. My parents visit it regularly to get canolis and buttercream-frosted half moon cookies just like I remembered from Hemstrought’s Bakery in upstate NY. I did a little googling on the topic and now I have a better understand of the upstate-downstate divide on this topic in New York which has apparently spilled over to other states.
So there you have it, two different sources for yummy cookies with buttercream frosting in the Raleigh area to choose from, or you can make your own. And if you do make your own…do yourself a favor and frost the flat side, ok?
Have a great weekend, all!
