in reply to Working on huge (GB sized) files

maybe you just need to parse these large files with sliding windows ?

Cheers Rolf