In order of easiest/cheapest (on developer costs) to most difficult ...

• Check your ulimit. If you have a limit on memory from that, then you'll get an out of memory error when you reach it. I had this problem - 64MB wasn't enough, so I just told the sysadmins that I needed unlimited memory, and that problem went away.
• Buy more RAM/increase swap space. If you still don't have enough memory after the above, then maybe it's because there's no more memory to have. My current home computer has 4GB of RAM and 8GB of swap specifically because of this. Of course, RAM is way faster than swap.
• Try upgrading to 64-bit. That means a 64-bit processor as well as 64-bit OS and 64-bit perl. With sufficient memory. If approximately 3.5GB isn't enough memory to access, then 64-bit will allow you to access anything you can throw at it.
• Try using a file-system-backed tied data structure. Since I don't use this, nor do I know what data structures you're using, I can't really tell you which one. But the basic idea is to throw all your intermediate results to disk, and read them back in as you need them. A tied structure, such as DBM or something, can radically simplify this. This allows you to use your hard disk as if it were RAM, without actually hitting the limits of your ulimit or CPU or physical RAM/swap.

Hope that helps.

---

---

Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!

Titles consisting of a single word are discouraged, and in most cases are disallowed outright.

Read Where should I post X? if you're not absolutely sure you're posting in the right place.

Please read these before you post! —

• How do I compose an effective node title?
• How do I post a question effectively?
• Markup in the Monastery

Posts may use any of the Perl Monks Approved HTML tags:

a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr

You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)

	For:		Use:
	&		&
	<		&lt;
	>		&gt;
	[		&#91;
	]		&#93;

Link using PerlMonks shortcuts! What shortcuts can I use for linking?

See Writeup Formatting Tips and other pages linked from there for more info.