As stated by others, you can't do this with any consitency. You may however be able to estimate how much memory a given calculation will use by running smaller calculations and watching the memory usage (e.g. with 'ps'). You'll probably want to limit your memory usage to some percentage of total real memory (rather than virtual memory) for best performance, but YMMV.

bluto