in reply to Edit huge file

First thing that pops into mind for me if you really want to avoid reading/re-writing entire file:

Disclaimer: I have limited experience with Tie::File, so not sure how it performs w/ larger files.

Replies are listed 'Best First'.
Re^2: Edit huge file
by BrowserUk (Patriarch) on Jun 18, 2013 at 22:45 UTC
    Disclaimer: I have limited experience with Tie::File, so not sure how it performs w/ larger files.

    Horribly!

    With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.
[reply]
      Thanks. For my own future reference, do you have a suggestion for a file size that is too large to use with Tie::File?
[reply]

        Hm. Say 1000 lines/100kB.

        Its actually not too bad for files ~10x that iff you know

        1. how it works:

          An LRU cache of limited size:

        2. what not to do:

          Don't use @theArray in either a list or scalar context;

        3. configure it correctly:

          The memory and dw_size options can interact in interesting but unintuitive ways.

          Bigger is not always better, especially if the predominant operations are deletion or insertion of whole lines, rather than in-place modification of existing lines.

        With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
        Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
        "Science is about questioning the status quo. Questioning authority".
        In the absence of evidence, opinion is indistinguishable from prejudice.
[reply]
[d/l]
[select]

In Section Seekers of Perl Wisdom