Re: write hash to disk after memory limit

To echo ww's comment - we don't have enough information.

A couple of more potential solutions might be a "better" algorithm or a disk-based hash store (DBM::Deep, as an example). Whether it helps with your use case or not depends on many factors, none of which we have at this point.

--MidLifeXis

Comment on Re: write hash to disk after memory limit

Replies are listed 'Best First'.
Re^2: write hash to disk after memory limit by QM (Parson) on Mar 13, 2015 at 15:23 UTC
For DBM::Deep, I recall needing 64-bit Perl for large files (>4GB). See DBM::Deep Large File Support for more info. But, as said above, this is only one of several options. -QM -- Quantum Mechanics: The dreams stuff is made of	[reply]
Re^3: write hash to disk after memory limit by MidLifeXis (Monsignor) on Mar 13, 2015 at 15:27 UTC
64-bit perl != largefile support, except on their test machines. I can attest that given largefile support in a 32-bit perl + filesystem support does work. --MidLifeXis	[reply]
Re^4: write hash to disk after memory limit by QM (Parson) on Mar 16, 2015 at 09:37 UTC
64-bit perl != largefile support, except on their test machines. I can attest that given largefile support in a 32-bit perl + filesystem support does work. OK. Seems like a documentation bug report is in order? -QM -- Quantum Mechanics: The dreams stuff is made of	[reply]
Re^5: write hash to disk after memory limit by MidLifeXis (Monsignor) on Mar 16, 2015 at 11:52 UTC