in reply to Strategy for randomizing large files via sysseek
I was having similar problem ...as the file size goes up there is too much thrashing , best thing is to use a database , Try using DBD::SQLite2 its Insertion is fast and if u want u can even sort the data .