Get list of files modified after a certain date without a for loopI'm trying to find all the files in a directory modified after a specific date. The directory is a network drive with a million files in it. So if I try to simply do a for loop with LastModificationDate(), it takes roughly six hours. Anyone every run into something like this?
Re: Get list of files modified after a certain date without a for loopRight now we're just running a simple batch file but that has its own problems. I'll try the MFI, it looks promising.Re: Get list of files modified after a certain date without a for loopIf MFI doesn't do what you need, open a cmd.exe window and see how long the DIR command takes. If it is too slow, there isn't much else I know to do, but it is possible it will be a lot faster. In that case, there is a scripting index example under RunProgram that will get you going (2nd example, I think).
DIR has a lot of arguments that affect formatting and results.
Re: Get list of files modified after a certain date without a for loopSee if this helps:
// requires JMP 14
// on a virtual machine, the network drive F will process
// around 50K files per minute this way
mfi=Multiple File Import(
<<SET folder=""></SET>
50K/minute for this configuration of a network50K/minute for this configuration of a network50K/minute for this configuration of a network
Columns include filter valuesColumns include filter valuesColumns include filter values
Re: Get list of files modified after a certain date without a for loopHi @vince_faller
perhaps you can try using the Files In Directory ()function as in the first section of the script by @Craige_Hales in this link: https://community.jmp.com/t5/Uncharted/Files-In-Directory/ba-p/21232
alternatively, consider linking to R and using the following:
https://stat.ethz.ch/R-manual/R-devel/library/base/html/list.files.html
Is this is in the right direction?
Ron
Re: Get list of files modified after a certain date without a for loopIt's not the for loop overhead. It's the network drive ping. Every call to it seems to take more than a second.Re: Get list of files modified after a certain date without a for loop@vince_faller,
Have you tried using Last Modification Date() in column formula in a private data table ?
