Welcome to the JMP Development Update for November 11, 2022!
As I am sure you are aware after Jeff’s email and the announcement on InsideJMP today, My.JMP is not quite ready for customer deliveries. Customer Care plans to notify customers to get JMP 17.0 via JMP.com/update. About 1000 JMP orders have already been fulfilled, so we know that customers who are passionate about the new version can definitely get access to our new features!
However, since distribution and usage of 17.0 has been more limited to date, JMP management has decided that we would like to permit some extra time for customers to adopt JMP 17.0 and report bugs that we can fix before we plan to go into approval mode and freeze our 17.1 maintenance update.
The current proposal is to delay approval mode and freeze at least a month and deliver JMP 17.1 with updaters once My.JMP is ready. Once the adjusted Code Approval and Code Freeze dates are finalized (likely early next week), we’ll update the 17.1 section of the JMP 17 Dates page with details and I’ll send out Outlook reminders. Rest assured we’ll try to avoid end of the year holiday collisions.
Please be aware that although JMP 17.1 Approval Mode and the final Code Freeze date for 17.1 will likely come after the holidays,
doc and L10N freeze will continue as currently planned to avoid pileups with ongoing translation projects.
This means that when considering 17.1 fixes, it will be important to avoid making changes that impact strings and doc. Please evaluate your change carefully and confer with doc/L10N as needed to avoid downstream impact.
As we continue on with Jira and Confluence in the Atlassian cloud, I wanted to being up a few more Jira issues where you can lend your vote! Thanks to
John Sall
for pointing out that the Jira report data field is hidden and not nicely formatted in the issue view. While visible in list views as a full date, in the issue view, that field is hidden at the very bottom of the right side panel (after you scroll all…the…way…down). This request has been commonly made, but has not been addressed so you can vote to make it appear more prominently here:
https://jira.atlassian.com/browse/JRACLOUD-70098
Another item I came across this week is the lack of an interface to edit a web link (or its label) once you have added it to an issue, but then want to change it. You can vote for this one here:
https://jira.atlassian.com/browse/JRASERVER-42710
The Jira web link interface is extremely clunky – in addition to the lack of edit support, I noticed this week that it’s hard to even copy the label text from the interface because it goes into link mode.
Thanks to Audrey for providing this Jira Tip of the Week!
Some of you have noticed that Jira tickets which were migrated from the old Defects system may have some html tags and bad formatting. This is an unfortunate result of an editor SAS was using, which we don’t have access to in our new Cloud Jira. We don’t have an automated way to fix them all up for you, but here are two options for fixing these.
-
The manual solution: go to the old Jira ticket in rndjira, copy the description there, then paste it into the current Jira ticket.
-
Use the Python script written by
Evan McCorkle
to avoid having to go to the old Jira ticket. Simply copy the description from your badly-formatted Jira ticket, run the Python script below, then paste the description back.
Install Python here.
from
tkinter
import
Tk
from
markdownify
import
markdownify # pip install markdownify
def
set_clipboard(s):
r = Tk()
r.withdraw()
r.clipboard_clear()
r.clipboard_append(s)
r.update()
r.destroy()
def
get_clipboard():
r = Tk()
return
r.clipboard_get()
if
__name__ == '__main__':
s = get_clipboard()
s = markdownify(s, strip=['pre'])
set_clipboard(s)
print(s)
General Announcements
Important Upcoming Dates
-
Adjustments to JMP 17.1 Approval Mode start and Code Freeze dates are coming – more details soon!
-
Please visit
Confluence
for a full list of
JMP 17
dates.
JMP Development Updates
Data Discovery
-
Evan:
Refined Home Window hierarchy for Platform launchers and Table tools/utilities (see first screenshot below). Added guided path from JMP Search to deep/dead Script Items. This adds a wizard-like header to Platform launchers and modal dialogs when triggered via JMP Search (see second screenshot below).
-
Dan S:
Reviewing remaining 17.1 issues. Fixed a data filter rerun hang, investigating additional data filter issues. Continuing to merge platform rerun in JMP 18 - drag-and-drop, column switcher, and the data filter now use the same routine to run the new platform and replace the contents in the report. Column switcher and the data filter now use the same "Empty Platform" to stand in for a platform that failed to launch.
-
Dave B:
Fixed a journal problem with dendroLabelSeg and while doing so discovered an unrelated potential crash which I also fixed. Updated jmprunner image tests running against the 17.1 branch to use the branched version of the image tests. Added the table of contents option to the page set dialog and the save as pdf dialog
-
Ernest:
Undo/Redo support for Workflow Builder.
DOE
-
Peng:
Continued working with Bill Meeker on his research project. Added one section that is on my duty list. Gave a technical presentation to DOE group about implementation of factor list prototypes. Add examples to factor list implementation to illustrate possible uses. Refactoring Degradation (
JMP-14627
). Turned on axis type change for the CDF plot in Distribution, which was implemented when probability scales were not available to users (
JMP-14652
). With the probability scales available, it is useful for one to change the y-axis to one of the probability scales. The need came out of a discussion with Bill Meeker on the history of the Q-Q plot. In his opinion, probability plots should be preferred whenever available. Working on a presentation on new Repeated Measures Degradation for next week’s Developer Tutorial presentation for marketing.
-
Caleb:
Working on cleaning out my 17.1 JIRA tickets. Submitted a paper to QREI that I’ve been working on with Peter Parker from NASA and Derek Young from University of Kentucky.
-
Brad:
About to submit a revision of a paper with Chris Nachtsheim and Ryan Lekivetz on mixed level screening experiments.
Host
-
John Schroedl:
Addressing more C++20 warnings. Thanks to all devs helping to fix up issues. The last remaining set are related to adding/subtracting values belonging to different enums. Investigating theming capability of Telerik controls as part of UI modernization effort. SAS’s new
privilege management s/w
, BeyondTrust, has arrived on my machine as I am in the pilot test group. Attempting my usual tasks which require admin privileges and reporting issues.
-
Paul N:
Completed the Product Security Level 2 training. Working with SAS legal on the Export Questionnaires for JMP and JMP Live. Continuing saga with the MapServer. The external server is so locked down that it’s taken several requests to be able access and install the necessary software. Still waiting on one to access the postgres.org repository. Revisiting how Python is loaded in JMP, buy looking at some of the APIs now available in Python 3.8 and newer that have been added to better support Python embedding.
-
Daniel Powell:
Nan and I are ironing out some bugs in the AWS web-activate system and hope to complete it in the coming weeks.
HTML5
-
John Powell:
Started contributing to the onboarding process for our new Sr Software Developer, Mike Stickles starting remotely from Pennsylvania on Dec. 1
st
. Integrated fixes into JMP 17.1 (
JMPHTML-1857
,
JMPHTML-1859
,
JMPHTML-1664
). Took a management curriculum course on unconscious bias. Monitored JMP Public’s Migration to JMP 17.0 and discussed the migration with Anderson Mayfield. Implemented support for Median Absolute Deviation error intervals(
JMPHTML-1865
). Completed one Level 2 security training module. Discussed and voted on
potential refactoring tasks for JMP 18.0
. Planned sprint and dev. cycle end meetings.
-
Praveena:
Worked on JMPHTML-842
GB: Line: Stacked with fill below using missing, hidden, excluded data gives different chart.
Started looking into JMPHTML-1869
GB Line : Data with Hidden/Missing/Excluded Incorrect tooltip
. Completed the Product Security Training.
-
Paul Spychala
: Doing security training, helping to plan our HTML refactoring sprint for 18, and broadening our support for text orientations [
JMPHTML-1208
,
JMPHTML-698
,
JMPHTML-707
,
JMPHTML-1420
]
JMP Live
-
Aurora:
18.0:
Improved performance of the calculation of a user's storage_used_kb. Removed some obsolete code (a database table attribute and a few REST API endpoints). Fixed a few small bugs.
Miscellaneous:
Puzzled over a database state oddity affecting ZAP scans (with Alex Taylor). Required security training. Working on Perforce --> Git change for JMP Live.
Statistics
-
Elizabeth:
Mostly deep in the guts of negative binomial GLMM estimation. The parameter estimates are now correct, finally! However, there are some discrepancies in standard errors and degrees of freedom to track down now.
-
Annie:
Continuing work on adding short run control charts to CCB, adding a new role for the product variable and starting on new elements for the short run points and short run limits values.
Stat Documentation
-
Michael C:
Continued updating 17.1 doc for SEM updates; answered Jira questions; investigating some Jira updates for the JMPDOC project to help the doc team.
Stat Testing
-
Mark:
Attended the first part of a design and code review by Peng for his prototype of the new table UI. Created half of a presentation for a JMP Dev meeting next month about usability testing of the new table UI with Jacob. Analyzed quantitative data from a usability study (DOE) of the new table UI with Jacob and Ryan. Worked with UI/UX workstream to define a UX Development Process. Developed a prototype of animated help for factor types and another for discovering interaction in Analyze step of Easy DOE. Worked on new features and other changes to Easy DOE with the team. Presented a Developer Tutorial about Easy DOE with Tom Donnelly and Gail Massari. Answered questions in JMP Community.
-
Jacob:
Testing Easy DOE in Flexible mode with all Generalized Regression methods. Testing MSA Design, writing new tests for expected mean squares used in the diagnostics. Collaborating with Mark Bailey and Ryan Lekivetz on analyzing Factor UI usability study results, and designing a follow-up study
-
Tonya:
Answered user community question about CCB with phases and tests. Preparing for Early Adopter presentation. Bug verification.
Product Management
-
Mia:
Revised feature page structure and discussions on readiness checklist. Product management sent out an EA survey on Columns Viewer and Header Graphs and received >185 responses (>40% response rate). Wow!
Technical Support
-
Duane:
First, Happy Veterans Day! Many thanks to all the veterans (and family members of veterans) across JMP. Their sacrifices and contributions to our nation are immeasurable and greatly appreciated.
-
As for TS, we are seeing JMP version 17 cases coming in. A couple of teaser pics are included here, but this information is available in the existing TS JMP Live Reports if anyone wants to check it out. So far, as one would expect, the majority of cases are regarding installation and/or the demo. TS is prepared for the notification of the availability of JMP 17 going out to our annual license administrators.
-
Here are the
TS JMP Live reports
and the usual plot below. I took a stab at creating a Jira filter showing the
tickets reported by TS for the last 14 days
. Can you access it? Have a great weekend!
Track/Case Volume by Week
JMP 17 Topics
JMP 17 Topics (truncated)
Development Operations
-
Jim B:
Salute to all of our veterans! Reported Jira tickets from the latest LEAKS UT run. Investigating Jira entries for installing JMP on an M1 mac. Software updates to some build machines and all daily UT machines. Perforce support.
-
Myron:
JiraBot 2.0 testing and fixes for errors. MemoQ permissions troubleshooting and Help build work with Qiana.
Documentation
-
Qiana:
Completed sample data table work for 17.1 and handed it off to L10N. Interviewed 2 candidates for the summer intern position. Continued reviewing resumes for internship. Worked with Myron on creating the 17.0 and 18.0 JMP Help. Working on 17.1 Jiras and translation inquiries.
-
Susan C:
Finished creating process Jiras for 17.1 and updated Confluence pages.
Here’s the Confluence page outlining doc deadlines for 17.1
. Worked on a text inset query from localization and progressing through JMP Live Jiras for 17.1.
-
Chris B:
Stat writer intern interviews. Working on JMP-7698, JMPDOC-1567, JMPDOC-1519.
System/Host Testing-Cary
-
Mandy:
Mostly worked on Data filter testing for Dan and Clinical fixes (18.0 and 17.1) – 2 fixes in 18, 1 in 17.1 so far; Tracked down a Tabulate crash with Packed columns, and sent development 4 JIRA’s we have with Crashes for Tabulate – hoping to see those fixed for 17.1 now with extra time; took 2 of the Security Modules(from this 2nd round) – 2 more to go; Verifying Jira’s and adding tests where needed; next up – work on Workflow builder for demo on Dec. 1st with P&G.
-
Josh L
: Completed the mandatory security training. Tested the JMP LIVE Database installer that now includes Postgres 14.5. Answered a few JMP Live installation questions from support. Started upgrading the JMP Live test servers databases from Postgres 13 to 14. Working of getting firewall changes done so our machines in AWS can connect to JMPDEV2.
-
Lisa
: Responded to comments on my hover labels blog post, submit test tickets for Jirabot testing, integrated image tests to 17.1 that were present in 18.0 but not the 17.1 stream, and completed a DOE usability study for Jacob Rhyne.
System/Host Testing-Beijing
-
Beijing team: JMP Live 17.1 I18N testing has almost been done, details in
[JMPTESTBJ-1777] JMP Live 17.1 I18N Testing - Jira (atlassian.net)
-
Eric Wang:
(1) Tested Jira bugs related to performance. (2) Added E2E test for in memory data table update,
https://jmpdiscovery.atlassian.net/browse/WEBJMP-6206
. (3) Updated E2E common function Updated JMPLiveGraphQL:DataSource() to support filter. (4) Updated E2E tests to run on Beijing Jenkins machines, other than Cary VMs.
-
Da Li:
(1) Verify and close 4 bugs which are related to components Import-MFI and Export, adding corresponding UT cases for MFI, adding into export manual regression for Export
[JMPTESTBJ-162]
. (2) Verify and close 3 bugs which are for component Client-General. (3) 6 new bugs created when testing
[WEBJMP-6201]
and
[WEBJMP-6267]
. (4) Done writing two E2E UT cases, adding them into both main (18.0) and 17.1 streams. (5) Writing 1 Jest test for
[WEBJMP-5359]
.
-
Mike Wu:
(1) JMP 17.1, 18.0 bugs regression testing. (2) Regression testing on the JMP 18.0 ODBC code improve, entered 4 bugs. (3) Investigated the ODBC drivers update quest and replied to
[JMPTOOL-392]
. (4) Activating JMP 18.0 Trial failed against Dev activation server met issues and discussion with Daniel, now the JMP Trial 18.0 activation is working good on Windows, but JMP ProTrial still has issues, sent to Daniel for further look. (5) JMP 18.0 telemetry testing resumed with JMP Trial 18.0 (11.08.2022) on Windows, and currently the testing is still blocked by below issues
:
No JMP ProTrial 18.0 Windows installer for Now; JMP Trial 18.0 failed to install on Intel Mac; JMP ProTrial failed activation on Mac.
[JMPTESTBJ-1770]
. (6) JMP Clinical 8.1 HotFix testing completed -
[JMPTESTBJ-330]
-
Kimi:
(1) Bug verification. (2) Update python version to 3.11.0 on Cary UT env. Details refer to
JMPTOOL-390
(3) JMP Live 17.1 I18N Testing (4) Working on adding JMP Live E2E tests, details refer to
Kimi - Weekly Completed- E2E
. (5) Fix “Unknown Operating System“error and update connection files for JMP Live, details refer to
Kimi - Weekly Verified - Tasks
. (6) AWS Virtual machines cannot connect to SAS servers, details in
Ports can/cannot be connected from AWS to SAS Network - China R&D JMP Testing Team - Confluence (atlassian.net)
.
-
Da Zhang:
(1) Tried to deploy JMP Live in Docker containers to see if we could facilitate the testing process. (2) Tried to deploy JMP Live/Database/JMP Pool in separated/distributed machines (instead of an All-In-One machine) as the Server (vmw-d10g604) that we’ve been using seems not performing very well. (3) Looking at UT failures. (4) Delivered internal knowledge sharing on Docker. (5) Created a confluence page on how to create self-signed certs for JMP Live.
-
Nala:
(1) JMP Live 17.1 I18N testing. (2) Work with Kimi and Da Zhang to investigate the connection issues from AWS to SAS servers. (3) Learning Docker and setup a Jenkins server within Docker. (4) Attended Agile training.
Note from Shannon
An update on my note from the end of last week’s update regarding the SAS Salvation Army Angel Tree project.
(Thank you Ryan L for also adding a comment to the related Inside JMP story!)
I saw an update posted on Yammer this morning that indicated that as of today 11/11/22, 184 angels have already been sponsored by SAS (and JMP) people. However, there are
still 166 children in need
of Angel Tree sponsorship including many older kids. I requested a child similar in age to my 11 year old son Hunter. In one of the last few years he even used his own money to purchase a toy for the other child. This program is always a good reminder to our family that many children are in need in our area.
Here are the project details, and if you visit the page with the MS form, it mentions that you also have the option to drop off extras on Giving Tuesday like new toys, underwear, socks or other oft-needed items. Here are more details from the post:
Salvation Army Angel Tree
It's that time of year again! SAS WIN is teaming up with the Salvation Army for the 2022 Angel Tree project. We currently have 350+ children to sponsor this year. Please fill out the **
MS form here
**to become a sponsor.
Please allow 1-2 business days
for us to process your request.
The details are listed on the form but this year we have also provided you a document to download and print for reference at \\d10d508\Public\SA-Angel-Tree\Angel-Tree-2022-Details.docx.
Drop-off at SAS will be one day only on Giving Tuesday, 11/29 from 8 AM - 4 PM ET at the LW loading dock.
Any further questions? Please contact
Judi Rourke
or
Christine Halk
