nav[aria-label="Primary Navigation"] { padding: 0; & ul { list-style: none; width: 100%; display: flex; flex-direction: row; justify-content: start; align-items: start; gap: 30px; padding: 0; & li { margin: 0; } & ul li { list-style: none; } } }

A very simple script is not working due to large no of rows, any suggestion ?

HSS

Hello,

I have a large set of data and I want to add a new column (Character) based on a pattern in another column. I have tested the script on small table, it is working fine but on my actual data set, it keep on trough error, see the attached image. No of rows in my data table is -- 1.8x10^6 and I am sure that is the issue. Is there any way I can make the evaluation bit slow in the script, hopefully that will work. Or any other idea/ suggestion.

Any help.

Script.jsl

Sample data.jmp

Accepted answers

Craige_Hales

Check the spelling of the column name in the large table.
I've never used the EvalFormula, and the if statement has an unusual trailing comma. Try something like this

dt = Open( "$sample_data/big class.jmp" );

dt << New Column( "Cat", Character, "Nominal",
	Formula(
		If(
			Contains( :sex, "M" ), "male",
			Contains( :sex, "1" ), "one",
			Contains( :sex, "2" ), "two",
			Contains( :sex, "3" ), "three",
			"female" // the otherwise case
		)
	)
);
	
dt << runformulas;

All comments

txnelson

I replicated your data into a data table with 2.7 million rows, and did not get a failure. Are the values of :Parameter more complex in your real data? Does the key that you are looking for always fall as the second segment of the Parameter

xx_KEY_xxx_xxx

HSS

Hi Nelson,

Thanks for prompt reply. No they are not complex and yes, I am always looking for the 2nd segment of parameter as you described. Is there any other way to make it happen ?

Craige_Hales

Check the spelling of the column name in the large table.
I've never used the EvalFormula, and the if statement has an unusual trailing comma. Try something like this

dt = Open( "$sample_data/big class.jmp" );

dt << New Column( "Cat", Character, "Nominal",
	Formula(
		If(
			Contains( :sex, "M" ), "male",
			Contains( :sex, "1" ), "one",
			Contains( :sex, "2" ), "two",
			Contains( :sex, "3" ), "three",
			"female" // the otherwise case
		)
	)
);
	
dt << runformulas;

HSS

Yes, it is working find. thanks.