Something else to think about: do you need to store all your data at once?

If your script is going to be called more than once and each invocation only needs to access part of the data, perhaps you can filter the data somehow before loading it into a hash for further processing.

Without knowing more about the detail of your application it's hard to tell whether this approach may be usable.

Paul