in reply to external file reference

Use a database, which does the IO intelligently for you.

In Section Seekers of Perl Wisdom