It's not easy to tell in the absence of test data how big this hash is, 
or how many time these loops iterate, but given the sizes of the data files 
mentioned in the OP, and the timing information you've supplied above, it 
appears that they may be substantial.