Something of an odd problem I am having (at least seems so to me):
I have a sizeable arrayref of arrayrefs (about 20000 arrays of about 75 elements: roughly 70MB in memory) which is the result of a fetchall_arrayref call with DBI.
It takes about 2 seconds to retrieve and load the data into memory, and then about 10 seconds(!) to undef the data structure (whether explicitely or just at the end of the script). This slowdown seems to be quite consistent - an early iteration of this script was using 10-20 of such data structures, so after it finished all the actual work, it would just sit there for 5-10 minutes before exiting - quite annoying.
One thing I noticed while playing with it is that if I undef the structure and then populate it again (from the same query in fact), the second undef is then instanteneous, or close to it.
This is all on RedHat Linux with perl 5.8.4
Can anyone shed some light on what exactly is going on?
Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
Read Where should I post X? if you're not absolutely sure you're posting in the right place.
Please read these before you post! —
Posts may use any of the Perl Monks Approved HTML tags:
- a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
| |
For: |
|
Use: |
| & | | & |
| < | | < |
| > | | > |
| [ | | [ |
| ] | | ] |
Link using PerlMonks shortcuts! What shortcuts can I use for linking?
See Writeup Formatting Tips and other pages linked from there for more info.