in reply to Caching and inserting big number of records

LOAD DATA INFILE is the best way to go. You just have to work out the details of saving the data to a suitable tab-delimited file.

In Section Seekers of Perl Wisdom