Method for regression testing JMP scripts

Question

Does anyone know of an existing approach that we can share for regression testing JMP scripts?  I have a customer that has a bunch of scripts that need to be tested with each JMP release; they currently do this manually and it’s very time consuming.  They want to check for script execution errors and compare results. Suggestions?

Thanks,

Jerry

michael_jmp · Answer

Hi Jerry,

Please see my response to Regression testing JSL scripts on new releases of JMP for some ideas that you might be able to pass along to the customer regarding regression testing JSL scripts in new versions of JMP.

Best,
Michael

martindemel · Answer

Hi Jerry,

if I got it right, your customer wants to have a Kind of xunit test for JSL. I'm not Aware of a ready to use program in File Exchange. So Jeff's Suggestion might be the best Approach.

In Basic you have to write several functions/classes to do such thing. One for running the tests, that is calling the scripts and check the return values with other classes/functions. One master class/function, which contains the Messages for Errors or differences to the true value, e.g. depending on equal, equal with variance, unequal, wrong Inputs/Outputs, wrong type of variable, ....

This could become quite complex and usually it grows with usage. So if there is nothing out there and development does not have something in stage for things like this (even I'd wonder if there isn't something, but may not be publically available) there is no short solution I believe.

Hope this helps,

Martin

Jeff_Perkinson · Answer

Hi Jerry,

It would be best to suggest that the user post the question to the Discussions in the Use Community. This is probably a lot of experience out there that could make suggestions.

Jeff Perkinson

JMP Customer Care Manager

SAS