in reply to System out of memory while storing huge amount of data
Usually I start using a database once the datasets get large enough. (Normally a large dataset invites reuse anyway, so putting it into a database keeps you from having to re-parse the source data files each time, etc.)
You may want to look at DBI and DBD::SQLite for a nice little database system that doesn't require a server, is easy to use, etc.
...roboticus
|
|---|