Hello, suppose I have a huge file "test_file.csv" (about 40GB).
...
But instead of prepending the line, it is replacing the existing lines!!

I suspect most monks reading this would be entirely unsurprised that the data were overwritten rather than prepending. That's because experience has taught us this (not just in Perl, but in using pretty much any language to perform file manipulation). So forgive me if I'm wrong in assuming that you are relatively new to all this.

If you are new to it then perhaps you could be so good as to justify why you have a CSV file that's 40GB in size? Experience says that this is very large for a CSV file. If you could reduce this size by an order of magnitude or more then the problem effectively vanishes. Of course it is entirely possible that every one of those 40 billion bytes is absolutely essential, just rather unlikely.

In reply to Re: Prepending header line to HUGE csv file by hippo
in thread Prepending header line to HUGE csv file by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.