in reply to how to handle large hashes

You'll find that perltie is a good starting point. See Tying Hashes.

In Section Seekers of Perl Wisdom