Read/omit particular columns from a .csv file

Question

Hi,

I would like to read in particular columns from a .csv file. The .csv files (which I currently read into jmp and concatonate) have hundreds of columns and hundreds of thousands of lines so the time to read the files into JMP becomes very large and also the JMP file becomes so big that it eventually freezes. As not all of the columns in the CSV are required for analysis I was wondering if a JSL script could target specific columns and therefore reduce the load time (and JMP file size). I have included a very much  simplified example below and simply would like to read in the .csv file below but omit the "sample_no" and "scene__max" columns so the jmp table only has 3 columns. (In reality I will be looking to exclude ~100 columns by name)

Any inputs on this would be much appreciated.

measurement_nosample_nolevelscene__maxscene__no_of_targets10041020310035600741

Craige_Hales · Answer

from the text import wizard for CSV files, on the 2nd page, mark the column excluded:

red slash circle

When you import, the script has the code you need to do it again:

Omitted Column

ian_jmp · Answer

If you could generate .XLSX instead of .CSV files, maybe there's a chance to use an ODBC connection to Excel and use JMP's Query Builder (and SQL) to use a subset of the columns for importing?

And depending on what the possibilities are for restructuring the data (if any), you should be aware of the virtual join in JMP (if you are not already).

David_Morrow · Answer

Thank you for your feedback I may have to look also at some pre-processing.