JMP v19 Graph Builder performance with large tables (13M+ rows)

Question

I’m running into significant performance issues with Graph Builder in JMP v19 when working with a large table (~13 million rows). In JMP v18, I was able to interact fluidly with the same dataset — panning, zooming, and switching variables were all manageable.  It’s a single table of about 13M rows, with a couple-dozen columns, on a pretty heavy workstation with 64 GB RAM.

In JMP v19, however, I’m seeing frequent “hourglass” delays and “JMP is not responding” messages whenever I try to create or adjust plots. Going back to JMP v18 with the same data and settings works smoothly again.

I’m wondering if anyone else has noticed degraded performance in Graph Builder with large tables since upgrading to JMP v19. If so, it might be worth JMP taking a look at what changed between versions.

Has anyone found any workarounds or settings that help (e.g., memory preferences, GPU settings, etc.)?

hogi · Answer

roundabout & acceptable.

On the other hand, just imagine how many calculations it takes to render a graphics game in real time.

Next step: create a graph. What is smooth, without no delay, what is too much waiting time?

To get more precise values for the creation of the table, one can use hptime().
and to take the calculation of the column formulas into account, one can wait for dt << run formulas.

t0 = hp time ();
dt = New Table( "test",
	Add Rows( 10000000 ),
	New Table Variable( "categories", 20),

);

New Column( "row",
		Formula( Row() )
	);
	New Column( "sin",
		Formula( Sin( :row / 10 ) )
	);
	New Column( "rnd",
		Formula( Random Integer( :categories ) )
	);

dt << run formulas;

write("t(s): ", (hptime()-t0)/1000000)

Ressel · Answer

5'' for all columns to be populated on my machine, give or take.

runtime of the JSL itself is <0.1''.

Is this good? I mean, 10 Mio rows, I think it is very much acceptable. However, dropping these columns into GB, it takes a while for it to respond. Still much better than trying to solve an issue like this in (dare I name it) Excel.

hogi · Answer

I think the number of columns doesn't affect the speed.
And for the rows, the time is different for the calculation of a bar graph of the mean and a point plot of all individual data points.

e.g. on my old notebook it takes ~ 6 seconds to calculate a box plot of sin() compared to 2 seconds for a box plot of row() - and quite comparable time in JMP 18 and JMP19.

Calculating a point plot takes longer, and it seems: a bit longer with JMP19 than with JMP18 ?
How about your system?

New Table( "test",
	Add Rows( 10000000 ),
	New Table Variable( "categories", 20),
	New Column( "row",
		Formula( Row() )
	),
	New Column( "sin",
		Formula( Sin( :row / 10 ) )
	),
	New Column( "rnd",
		Formula( Random Integer( :categories ) )
	)
)