JMP Performance

Question

I am trying to go through a data file (dt1) that has about 10,000 rows.  I have a FOR loop that goes from 1 to the NROW(dt1).  It appeared to be hanging so I put in a bunch of SHOW statements to see what was happening.  After processing about 2000 records, no more show statements were being displayed in the log.  I decided to wait, and after about 10 minutes, the script finished and the rest of the SHOW statements were blasted into the log.

Does anyone know why after about 6000 show statements, JMP looks like it isn't doing anything?   Is there a parameter I can set to keep the SHOW statements going?

Thanks

unknown · Answer

When you use a construction such as a For loop from 1 to NRows the execution time does not scale linearly with the number of rows.  For a large number of rows it becomes much more efficient to use the implicit row reference: For Each Row

pmroz · Answer

Look at the following JMPer Cable issue, in the Tips and Techniques section:

http://www.jmp.com/about/newsletters/jmpercable/pdf/20_summer_2006.pdf

Regards,
Peter

whom · Answer

I had to step away from this to address some other issues... but I'm back trying to figure out what is happening...

I'm trying to loop through over 10,000 records in a JMP data file.  There are several if statements that are using the LENGTH and INDEX functions.  There are a couple of bean counting variables.. nothing complicated!

out of frustration, I altered the parameters for the FOR loop, to look at rows 10585 to 10590 only.  Never got any of the show statements to display in the log, and after 5 minutes, i killed the job.

Can you give me the link to the append that you referenced about exponentially long execution times for large files?