.csv Import error

Rob1

Hello

New JMP user here. I'm just trying to import data from a .csv and I'm getting this error:

The original data in the .csv looks like this:

This is how it imports using best guess:

This is how it imports as plain text:

Does anyone know what's going on?

Craige_Hales

Yes, the nul characters are a problem. Here's a possible workaround:

 

// make a CSV file with nuls in a field
filename = savetextfile("$temp/nuls.csv",chartoblob("a,b,c~0D~0A1.1,~00~00~00,1.2~0D~0A2.1,~00~00~00,2.2"));

// load the file into a blob so we can clean it up
blobdata = loadtextfile(filename,blob);

// convert the blob to text so we can manipulate the nuls as ~00
textdata = blobtochar(blobdata);
write("\!nbefore = ", textdata);

// fix it up, convert nul to space
substitute into(textdata,"~00"," ");
write("\!n after = ", textdata);

// convert it back to a blob, handling the ~0D and ~0A that remain
repairedblobdata = Char To Blob(textdata,	"ascii~hex");

// at this point, you could save it (like above) or open it from memory:
dt = open(repairedblobdata,"text"); // tell JMP to interpret the blob as a CSV text file

 

JMP strings are limited to 2GB, so if you have extremely large files this will not work.