in reply to Re: Data parsing - takes too long
in thread Data parsing - takes too long

If creating the hash with the entire file is consuming too much memory, try to break the input file in pieces, if possible

or better use DB_File or similar to create an on disk hash/tree.