A sincere thankyou to everyone for their assistance and ideas,

To Moritz: Ofcourse!! *Slaps Head* I saw that reference in Dumper and thought it was wierd - Fixed! Thankyou

To BrowserUK: Very smart. This was a great idea which I hadn't tried. I started to write it when I made the decision to drop HAshes. I think it would have worked really well, but I just decided that given the amount of seaches I am doing on this data set the SQLite idea would set me up for some further expansion. However, certainly joining the data would have allowed it to live 'inside' the hash and made it storable which would be fantastic.

To ~~David ~~: Excellent Point. I had switched strict off temporarily and had forgotten to enable it again. Saw that ARRAY issue immediately. Thankyou.

To Marshall: I am going to try using SQLite. I was concerned as I use Cygwin on Windows XP, that CPAN wouldn't install it correctly for me..however it did and so I think it might be a great solution. Its a little disappointing to drop the Hash as I had come up with a number of extremely create referecing mechanisms and subroutine calls to the arrays....but the amount of data I am dealing with is immense..(1.5GB of text per run) and I do agree having access to SQL queries will benift me in the long run. Thankyou for convincing me I should just bite the bullet.

To CountZero: I was too embarrassed about other bits of my code to have you guys look at it but I appreciate your point and will provide a working program in future requests. Although I will say that thankfully, this time around, the answers here were very useful.

In reply to Re^2: Hash of Arrays - Pushing Array references and memory impacts question by alittlebitdifferent
in thread Hash of Arrays - Pushing Array references and memory impacts question by alittlebitdifferent

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.