Another mechanism you mentioned is to look at the creation time or mod time. If you can figure out the maximum upload time, your script can skip files younger than that threshold.

For example, if you say every file will take 1 hour max to upload, a five minute old file could be still uploaded. But the two hour file is safe. This doesn't work if the files are really big, the upload time varies too much, or you need frequent processing.