in reply to Re^2: quick way to read a few directory entries of many
in thread quick way to read a few directory entries of many
Depends on your definition of 'processed'. I've had similar jobs, but the files only needed to be processed once. More accurately, each instance of a file only needed to be processed once, so I always mv the 'done' files to an arc dir and gzip them as I process them.