in reply to Large Set Efficiency Question

Just a guess here, not a tip exactly: while you're iterating over @found, would it be faster only to split when the timestamp doesn't match? I.e.:

foreach $f(@found) { if ($max !~ /$f/) { ($id)=split(/\|/,$f); push @set, $id; } }

BCE
--Your punctuation skills are insufficient!