About the Survey
Purpose
The main purpose of this survey is to gain insight into how our global users interact with JMP to (1) better profile JMP users and (2) identify areas for improvement for the short and long term.
Process
Sample Selection
For this preliminary release of the survey, there existed two major iterations: The first release targeted English-speaking users, and the second targeted users in China, Japan, and Korea. The sample of available contacts was queried from Salesforce and subsequently filtered to obtain a population of users that could be sent surveys. Tuples were excluded based on the following criteria:
- Non-JMP users
- Deleted contacts
- Bounced emails
- Missing emails
- Individuals who opted out of emails
- Affiliation with certain companies/accounts
- Europeans who did not opt in to email nor subscribed to newswire
After this filtering process, a population of approximately 260,000 emails were available for distribution for the first release in English. Ultimately, 52,000 randomly selected contacts were sent surveys. For the second release in Asia, approximately 27,700 people were available to send surveys— 13,371 in China, 11,388 in Japan, and 2,947 in Korea. The entire population was sent surveys for the Asia release.
Timeline
Qualtrics was used as the distribution channel for the surveys. An initial trial run was performed with 2,000 messages which was distributed on June 3, 2021. The remaining 50,000 of the English surveys were then distributed on June 24, 2021. After the success of the first release, the survey was translated and released in China (Nov 8), Japan (Nov 8), and Korea (Nov 22) in the fall of 2021. The survey was left open for two weeks after the initial invitations were sent. Reminder emails were also sent both one week after the initial invitation and 24-hours prior to the survey closing. Those who completed the survey were provided a free copy of the book “JMP Essentials: An Illustrated Guide for New Users”
Response Rate
The global response rate was 6.52%. The response rate can also be viewed by Sales Region shown in the table below.
Survey Structure
The format of the survey was a mixture of multiple choice, short answer, and Likert scale questions. You can view the full survey in the attachments.
Overall Results
From the responses collected, most respondents are users of either JMP (66%) or JMP Pro (31%). The breakdown of the products and associated versions is shown below. Note, multiple products could be selected by a single individual.
Most users reported working within the Research and Development functional area. Of the provided options for job description, Senior Manager/Manager/Supervisor (18%), Data Scientist (9.6%), and Analyst (8.7%) were among the top three. Regarding areas of JMP use, most people reported using JMP for statistics, predictive modeling, and data mining (33%).
Regional Results
Graphs pertaining to overall satisfaction, net promoter score, frequency of use, and years of use have been broken down by sales region as follows:
Room For Improvement
A segment of this survey was dedicated to identifying how JMP Users rely on software other than JMP for various parts of the analytical process. It was asked, “How often do you use tools other than JMP to (1) prepare data, (2) analyze, and (3) visualize data”. The results of the iterations of this question can be seen below.
Additionally, open-ended questions were asked to understand how JMP could improve to reduce such reliance on other tools. A few quotes are highlighted from responses below. The majority of comments requested more access to training materials. Of note, it was also a frequent comment in the Asian countries to have greater accessibility of training materials in non-English languages. Other comments referenced a desire for UI/UX improvements especially as it regards general software navigation, accessing help within the software, and customization of charts and graphs.
Conclusions
From this analysis, the main takeaway was an acute need to educate users on all the available resources, such as the User Community, for education about JMP software. Especially focusing on ensuring all sources for training online are accessible in non-English languages.
Further, UI/UX enhancements within the software, particularly for the advantage of newer users, to make actions such as navigation and customization of graphics would be beneficial to hone for the long-term. The raw survey data is attached for your own exploration.
What’s Next?
This survey is planned to be released on an annual basis. In preparation of the 2022 release, teams will be consulted on these findings and edits will be made to improve the survey. Please contact @Taylor_Ferguson for any questions/comments/insight for the next release.
The JMP Users Platform will be launched to poll users on a regular basis. The purpose of the JMP User Platform is to regularly acquire data on users’ interaction with the software in the hopes of enhancing our product offerings and services.
