Welcome to the JMP Development Update for June 23, 2023!
We have now reached our JMP 18 EA4 Code Freeze milestone. Many feature pages have been updated, and we have a lot of information to share with the EA members, including usability studies for Short Run Control Charts and Response Screening. Thanks very much to everyone for sharing feature updates! You must finish your feature page content updates (including any attached videos and usability studies) by the end of the day on 6/27 for your details to be included in the EA4 webpage updates. EA4 installer testing will begin next week.
EA4 will be our last EA before JMP 18 Development and Marketing Feature Freeze planned for 7/21/23. Many downstream teams (documentation, testing, translation, marketing materials, training) depend on features being completed prior to this date so that they can finalize materials and testing efforts. However, each release we have some features that unfortunately cannot make that date. Near the end of JMP 17, we created a page to track Jira issues still under development after feature freeze. You can find the JMP 18 version of the Late Features page here in Confluence. If you have Story or Epic items in the JMP project that are still being actively worked on as we pass feature freeze, please provide the requested details about impact to downsteam teams on the page.
We are now just a week from our JMP 17.2 Code Freeze milestone. Thanks to everyone for continuing to triage 17.2 items, resolve fixed issues, and request approvals for critical fixes! The list of open items with Planned Version = 17.2 has been dwindling throughout the week. If you own any of these open items, please triage them to determine if they are still a problem and if that problem is important enough to fix for 17.2. If you do not plan to address a given issue, please remove 17.2 from the Planned Version field.
Thanks to Xan Gregg, Julian Parris and other members of the Data Discovery team for volunteering to present at upcoming dev demo meetings! We will also have intern presentations coming up in July and August. Please update the schedule on this Confluence page if you would like to volunteer to present at a future meeting.
General Announcements
- Meet the Interns this week features Parker Dingman and Maddie Walsleben!
- If you’re willing to be a featured employee on Inside JMP, please download a copy of the Get to Know form. Simply fill out the questions and when you’re done, upload it, along with 3 photos of you to the folder. Thank you for helping to make our JMP family a little more familiar!
Important Upcoming Dates
- JMP 18 EA4 Freeze – 6/23/23 ß TODAY
- JMP 17.2 Code Freeze – 6/30/23
- JMP 18 Feature Freeze – 7/21/23
- JMP 18 EA5 and JMP Clinical EA3 – 8/11/23
- JMP 18 EA6 and JMP Clinical EA4 – 10/3/23
- JMP 18 EA7 and JMP Clinical EA5 – 12/8/23
- Please visit Confluence for a full list of JMP 17 and JMP 18 dates.
JMP Development Updates
Interns
|
Data cleaning with regular expressions
Picture this: you're a fearless data explorer, venturing deep into the untamed wilderness of raw data. Armed with your trusty spreadsheet and a cup of coffee, you embark on a quest to extract meaningful insights. But alas, what you encounter is a jungle of inconsistent formatting, cryptic symbols, a...
community.jmp.com
|
- Hamid Sanei: Attended informative sessions including "Coffee Conversation with John and Jon," "Maps Accessibility intern project orientation," "Mid-summer survey information session + Q&A," and "Intern Expo: What to Expect." Registered for the upcoming Intern Expo. Had a productive meeting with Laura Castro-Schilo to discuss the Mediation Analysis example and logistics for adding new datasets. Identified two educational datasets of interest and established communication with the dataset creator, an associate professor of education at NC State University. Working on the necessary steps to successfully incorporate these datasets into the SEM chapter. Completed another round of quality control for the SLS_Examples chapter. Currently in the process of substituting the Boston Housing dataset with a more suitable alternative and revising any related examples. Team meetings.
- Momena Monwar: Continued working through STIPS. Drafted email for technical reference library survey for SEs and discussed TRL updates and content categorization and potential retirement. Did survey and added more information to the Broadcom business opportunity database. Continued working on analyzing my Raman spectroscopic data utilizing Functional Data Explorer and found how external factors may impact the behavior of the sensor
Learned about the new spectral analysis tool which will help to find peak of the absorption data along with the area under the curve values.
- Trevor Rathje: My Semiconductor industry final project was given to me this week and the goal of the project is to find out how to increase JMP sales to companies within the industry. I have been working on collecting data and analyzing it so I can give it to my fellow interns. They will then use the data to come to conclusions on their focused areas for the project.
- Sohail Lokhandwala: Finished training models in all 7 languages and are happy to see that we’ve exceeded human level performance in every single one of them! We are now moving on to experiment with open source libraries to see if we can improve our performance on the testing dataset by tuning hyperparameters in the model.
- Parker Dingman: Working on using multiple http request and other JSL functions to import the clean, custom dataset I will need for my real-time weather map project. I have also been planning my intern expo poster, which was explained in a meeting yesterday, due 3 weeks from today.
- Michael Lee: Had a customer meeting in person, a couple hours from where I live. Working on a white-space project with all 9 sales account executives, and I just finished my biotech funding and associations projects.
Statistics
- John Sall:
- Fixed a bug in Fit Least Squares where Leverage Plots didn't show with "Minimal Report" if Profiler called before Leverage Plot option (JMP-17214).
- Developed a new Profiler launch dialog that is much simplified. It only shows the formula columns, and reduces the Noise Factors to a separate prompt. The new and old dialogs are shown. (JMP-16578).
- Working with Oneway to reproduce the same report order in the generated script. Here you see two Oneway scripts with the order of options reversed between the two, and the resulting saved scripts from the resulting analyses preserve the order. (JMP-15860).
- Laura C-S: Prepared presentation slides and short videos on SEM for a conference I’m attending next week (Modern Modeling Methods) at UConn. Met with Hamid to answer questions about the mediation doc example he’s working on. Also guiding him through the process of adding a new sample data table in JMP. Created new feature page for platform-wide bootstrap in SEM.
- Annie: Worked on fixing crashes introduced when I changed the Start Over routine in CCB to use replacePlatform(), rather than emptying the Undo stack, closing the window & opening a new window.
Stat Documentation
- Michael C: Reviewed draft of EA4 help for formatting and to ensure the latest content was included; cleaned up some Jira issues (adding missing contact roles and fix version values); updated doc for some small changes in various platforms.
- Karen: Working on updates to the workflow builder documentation.
Stat Testing
- Jacob: Verifying DOE fixes for 17.2. Testing ‘Save Excel File’ in Categorical. Updating usability studies for EA4.
Technical Support
Product Management
- Mia: Held a mini-retrospective to identify improvements to EA process for EA4. Thanks to those who participated and shared ideas. Many meetings with JMP interns to share the JMP commercialization process and the role of the Product Management team. If you want to learn more about who we are and what we do, see this page.
- Bryan F: Answered UI/UX questions and provided feedback on designs. Developed and revised icons. Addressed external question regarding accessibility concerns and began making plans for future accessibility improvements.
Development Operations
- Myron: Migration work for JMP 18 help build to AWS is almost done (JMPTOOL-861) - fixed some problems with networking and permissions. Fixed perforce and other issues with Tracked Edits job (for doc team). Worked on JiraBot updates to better capture ongoing updates (needs testing).
- Bob: Converted digital signing for version 18 to be inside the installers instead of a post-install script. Finished processing design for 17.2 projects with SAS release. All products are successfully working within SAS release test systems.
- Shannon: Reviewed remaining Jira issues with Planned Version = 17.2 in preparation for upcoming code freeze. Began reviewing JMP 18 unit tests that are not currently completing (DNCs) and entering Jira issues for some cleanup efforts under JMPTEST-586.
- Jim: AWS migration (thanks Nick). Jira reporting and verification. Updating UT machine scripts for embedded Python. Perforce support.
Documentation
- Qiana: Worked with Susan to identify end of project tasks. Generated JMP 17.0 Help; performed troubleshooting on why the Help didn’t include recent changes. Made updates to the WebWorks files and was able to push the JMP 17.0 Help files to production. Worked with Chris to figure out why JMP 18.0 Help didn’t include updates. Began addressing sample data table Jiras. Attended the Intern Performance Assessment info session + Q&A. Met with Michael to discuss changing doc for San Francisco Crime and Boston Housing. Identified that UG and JSG screenshots which might need to be updated to address the changes made to the San Francisco Crime data. Pushed JMP 18.0 Help for EA4 to production. Project planning.
- Susan C: Updated the Quick Start content with feedback from Chris B and made some fixes. The QS content is now in the Windows build, and should be in Mac, too. I did notice that a few inline icons were not showing, so I fixed that problem today. Working a Jira for doc tasks that need to be done at the end of a project/just prior to release. Ran the reset script on all books so writers can continue work post EA 4.
- Devon: Reviewing changes in Using JMP and JSL Syntax Reference files for EA4, final review of suggestions for edits from the JA localization team, working with the style sheets we use to produce the web help and the PDFs.
- Emily: Finalizing my edits for the Working Smarter videos as well as starting to edit the Graph Building chapter.
Web Testing – Cary
- Josh: JMP Live Story / Bug testing – focus areas, avatar sync, publish, installer testing for 17.2 and 18.0 due to version updates because of security fixes. Provide a connection workaround to Myron to get some of the copies working from a machine in AWS. Worked with Steve Chen and Rebecca change on a connection issue. Worked with Michael Goff on an odd time stamp issue some users were seeing a publish time. Setup a new Test realm in Keycloak that connect to SAS AD and My test AD as well as Google Auth.
- Anna: Testing Dendrogram. Reported issue with Contour published to JMP Live. Issue with contour labels. Tested new UI that allows user to specify custom contour levels. Verified bugs.
System/Host Testing-Cary
- Mandy: Worked on Template testing and talked with Evan about confusion that I had over what to do with them, hoping to help when they explain this for our EA4 users. Reviewed Workflow builder issues in initiated status to see if problems still existed or had been fixed. Verified JIRA’s in various areas, added test cases where I could; Worked on a Data Filter preference change (JMP-16934) for EA4.Found a hang/crash on the Mac with Edit > Undo inside Workflow Builder and built Xcode to try and point to the location of the hang (JMP-17201). Tabulate still has some crashes that may need attention in JMP 18 (JMP-17202).
- Lisa: Continued testing the overlay encoding feature in graph builder and submitting image tests, verifying various bug fixes, and reviewing EA tracks. Updated environment variable to self-identify.
System/Host Testing-Beijing
- Team:
- JMP Clinical 17.2 I18N testing Round 2 - in progress (JMPTESTBJ-2408)
- JMP 18 I18N Testing Round 1 - done
- Eric (Nai) Wang: (1) Investigating JMP Live JSL test failures, intended for both 17.2 and 18.0. (JMPTESTBJ-2411, JMPTESTBJ-2417, JMPTESTBJ-2416). (2) Testing new feature “checksum for data post” (WEBJMP-6831). (3) JMPC 17.2 i8n testing.
- Mike Wu: (1) JMP 17.2&18.0 bugs regression testing. (2) MySQL crash issue investigation and updated in bug JMP-16807. (3) JMP 17.2 Early Install Testing Done (JMPTESTBJ-2476). (4) Technical support issue investigation and provided feedback for case number: 00044095, 00034874, 00043948, 00043951. Entered bug for 00044095 (JMPHTML-2193). (5) Investigation on the query builder issue that reported from a community customer, Mike checked with JMP Pro 17.2 (06.19.2023), JMP Pro 17.1 (03.07.2023), JMP Pro 17.0 (08.23.2022), but cannot reproduce the issue and provided the detailed test result to Audrey and Julian. Found another issue during investigation and entered bug JMP-17191.
- Kimi(Yu) Wang: (1) JMP NF testing for python (JMP-17093, JMP-17176), SAS integration deprecation notification (JMP-15995). (2) Technical Support: Case Number 00044080. Entered bug JMP-17177: CRP: Embedded python for JMP 18 is also being used by previous versions of JMP. (3) JMP C 17.2 I18N Testing - Round2. (4) JMP Live 18.0 I18N Testing. (5) Jenkins: Optimization: Add compare function for Load Testing, for details refer to JMPTESTBJ-2479.
- Da Zhang: (1) Working with Kimi on load testing failures. (2) JMPC 17.2 i8n testing. (3) Fixed OLE automation failures. (4) Bug verification.
- Nala: (1) JMPC 17.2 i8n testing. (2) JMP 18 I18N testing. (3) bug verification. (4) Prepare for Q2 goal setting and Q2 conversations.
Data Discovery
- Julian: Welcomed senior associate software developer Morgan Gribbins to the team and provided onboarding support. Continued work on Platform Templates: updating pages, creating an overview video, and building a small set of sample templates that will be included in EA4. All installed 18 builds will now show the “Examples” folder in several platforms when clicking the Platform Templates icon – thanks Bob and Jim for updating installers to place the sample templates file.
- Evan: Fixed v17.2 Mac Subscription issue related to thread-safety of interacting with the license file. Term speedups for character columns, looking at removing the 2k character truncation for some cases. Platform templates work for Scale Box, Graph Builder, and Control Chart Builder. Trying to get the Telemetry Explorer Add-in checked in to P4 and talking with Confluence via REST API.
- Dan: Added JSL methods to get where-expression or by-levels from a platform. Work on data filter scripting to better handle non-default preferences. Continued work on Platform Templates - various updates to the template icon/menu behavior, and surveying platforms for future template work.
- Dave B: Tracked down and reproduced a threading crash that was happening about 5% of the time in image tests, fixed scatter3d bug, added the ability to set font styles per row for strings in a table box, fixing the size of icons drawn in a IconStringColDisplay.
- Xan: Better synchronization between Graph Builder and Properties pane, allowing more customizations without journaling.
DOE
- Peng: Finalized formatting requirement and published “Discussion of Specifying Prior Distributions in Reliability Applications — Applications for Bayesian Estimation Software Design” in Applied Stochastic Models in Business and Industry. Finalized formatting requirement and published “Vibration Time Series Classification using Parallel Computing and XGBoost” in IEEE PHM 2023 Proceedings. The work is a use case of JMP in the domain. Continue working on both fronts of DOE and Reliability development for JMP18. Created four sample data sets for Fatigue Model and filed a Jira to add them into the product.
- Brad: Working on a revision of a paper describing a way to use the alias information for a design to improve power in model selection. The paper applies the methodology to 7 and 8 factor nonregular orthogonal designs with 16 runs. This work is with Doug Montgomery of ASU and Carly Metcalfe of RIT.
- Caleb: Started work on adding profilers to the diagnostics section of the new CSALT platform. Hope to have them in by next week.
Host
- Paul: Updated Windows version of Python to 3.11.4. Updated jpip wrapper script to hide less of pip. Usage is now: jpip install --user py_package(s). Pushed initial implementation of Python DataTable object. Can create a new data table from Python, which can be passed to JSL. Added support to create new Python Script from within JMP. Fixed File->Save, and Save keyboard shortcut for dirty Python Script files on Mac. Updated EA 4 documentation for Python Integration. Fixed static analyzer warnings. Meeting on Student Subscription and SSO (Single Sign-On). Helped Evan debug a multi-threaded issue on MacOS relating to Subscription and Help Server query construction causing race condition while processing the license plist file.
- John Schroedl: Added compile time flag, TELEMETRY_ECHO_TO_LOG, to print telemetry info to the Log window as it’s generated. Filter the log to “Telemetry:” for a nice view as you add calls. Add more telemetry for File menu items including Save/Export. Wrote up confluence page about self-identifying as JMP employee for telemetry, crash and future JMP use. Added ‘Refresh’ tool and command in Home Window recent file list to update file availability state for users who connect to VPN after launching JMP. MATLAB debugging. Icons and sizing work.
- Michael H: Finished up new development on PI Server Import for JMP 18. Now I’m just fixing all the bugs!
Interactive HTML
- John Powell: Building a local JMP Live server to update and debug server side support for multiple local data filters (JMPHTML-1000). Preparing for Q2 development conversations. Participated in Sprint Retrospective and prepared material for Sprint Review. Started planning for next sprint. Onboarding for new developer, Michael Senoyuit (starting on July 6th). Provided input on how to verify Interactive HTML dendrogram implementation(JMPHTML-2136). Triage for a Contour Plot failing to regenerate on JMP Live (JMPHTML-2198).
- Paul Spychala: Added Prediction profilers to Mixed Models in JMP Live/HTML [JMPHTML-2197].
JMP Live
- Aurora: Continued work on folder level access. Upgraded some 3rd party libraries.
Note from Shannon
