Is there an easy way to find our where all the memory is being used in my process?

For example something that can tell me how many scalars, and estimate their data size + Perl overheads on a per-package basis in bytes?

Or even better something that can take a nested data structure and summarise how much data + overhead (hash buckets, key arrays?) is being used at a specified depth?

Or code analysis tools that let me know about long lived large data structures that are not referenced again?

Does releasing a hash make the recovered memory available to subsequent Perl structures?

Are there any tips on efficient memory usage? I am not programming in a web environment, but rather a large commercial data processing environment. Current processes sometimes suck up to 1.5G RAM when performing set operations. They run ok, but we would like to increase our capacity to process larger sets.

Seeking wisdom, and offering thanks in advance,

Jeff

In reply to How do I dumping Perls memory usage? by jaa

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.