How to use JSL to make TXT files of decimal data into binary format files?

lwx228

Decimal files use recent tabs to divide data into three columns.
They are all integers:
The data in the first column ranges from 90,000 to 199,999
Column 2: positive integers from 100 to 900,000
Third column: positive and negative integers or 0

They have a lot of rows.
There is no limit to how to save them as binary files or file suffixes using JSL.
And   need to figure out how to re-read restored decimal data from this new binary into JMP.
Thank you very much!

Craige_Hales

Open the preferences and look for the option to allow short integer columns. Create a data table with the data and use four bytes for each of your columns (available in the column dialog after you turn on the option.)

Using a 4-byte integer

I forget the exact rules, but approximately:

• 1-byte columns represent +/- 1e2 and missing,
• 2-byte +/- 3e4 and missing and
• 4-byte represent +/- 2e9 and missing.

 

Optional: turn on the whole table compression before saving. That will use a zip-like compression that might compress even more, but only on disk, at the expense of slower saving and loading due to compression.

Using 4-byte integers will be half the size of 8-byte doubles. I think that will be true even after loading in memory. Turing on compression for the 8-byte doubles is likely to make the file almost as small as the compressed integer file because it should find the same redundancies to squeeze out.