in reply to Re^2: Edit huge file
in thread Edit huge file

Thanks. For my own future reference, do you have a suggestion for a file size that is too large to use with Tie::File?

Replies are listed 'Best First'.
Re^4: Edit huge file
by BrowserUk (Patriarch) on Jun 19, 2013 at 01:14 UTC

    Hm. Say 1000 lines/100kB.

    Its actually not too bad for files ~10x that iff you know

    1. how it works:

      An LRU cache of limited size:

    2. what not to do:

      Don't use @theArray in either a list or scalar context;

    3. configure it correctly:

      The memory and dw_size options can interact in interesting but unintuitive ways.

      Bigger is not always better, especially if the predominant operations are deletion or insertion of whole lines, rather than in-place modification of existing lines.


    With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.