MFI column filename with empty linesHello,
I have a problem with Multiple File Import. I am importing a large number of .csv files using the MFI and I have activated the option to create a column with the name of the file. Subsequently I concatenate all the tables created in a large table. I automated this whole process through a script. At the end of the execution of the script I end up with lines whose File Name column is empty. This gives me a big problem because the filename lets me know which product my data corresponds to and without this filename I have test data that doesn't make sense because I can't relate it to any reference.
Do you have any idea where this problem comes from?
Thank you in advance for your answers.
Elise B.
Data TableScriptingRe: MFI colonne nom de fichier avec des lignes videsCan you show the import script and the concatenate script?
Can you tell which files might have produced a blank file name?
Is the missing name an occasional single row, or a run of rows?
Any log messages?
My guess is: you are doing more than one MFI, and one of them left out the option for filename (misspelling perhaps.)
Re: MFI filename column with blank linesThe script is attached to this post!
I'm not sure which files might have produced an empty filename as I import a lot of files and their data is relatively similar and there is no column besides the filename that clearly allows me to identify it. I also can't tell if these lines with empty filename come from the same file or not ...
I have no message in the log, the scripts run to the end without error ...
Re: MFI colonne nom de fichier avec des lignes videsMy next guess is
dt_list[i] << Select Columns( all );
dt_list[i] << Compress Selected Columns();
is compressing the filename column in a way that won't work with concatenate. Try leaving it out. If you need to compress columns, it will be better to wait until all the concatenations are finished. Some of the compression techniques depend on knowing all the possible values.
