Re. Perldoc's sysread - I see I can read a certain number of bytes from file end, which definitely helps as they grow bigger, but don't I need to read certain number of LINES to put .csv into array? That would be neat. Do I need to open another question for this?

I don't understand why sysread was even mentioned in the context of your simple problem of appending lines to existing files. Low-level I/O doesn't lend anything useful to you in the trivial case of your small text files of CSV data.

Alternatively, I see I can open files in append mode but then I'm not sure how I could add multiple lines. … For brevity, in append mode, I'd have to have something like this $csv->print($fh, $row); going in a loop before I close $fh?

Yep, that's the usual way, I think.

use autodie qw( open close );

use Text::CSV_XS;

my @records = get_records();

open my $fh, '>>', $file;

for my $record (@records) {
    $csv->print($fh, $records);
}

close $fh;

[download]

But based on your explanation of the requirement to create a new CSV file each time you add records to it and to keep the old file around as part of a file backup management strategy, I don't think you really want to append lines to an existing CSV file in place, do you? You simply want to create a new file each time you have new records to add to it. Your file naming convention might use ISO 8601 timestamps for the "old" files. First, rename the file to its new "old" name (e.g., one with the current timestamp in it), then open the just-renamed file for reading and open the main file name for writing. This seems like the simplest strategy to me and it's the one I regularly use.

Re. databases - I plan to work with these files on two different computers alternatively, so sometimes I have to add only one or two lines and sometimes would I need to catch up and add twenty or even two hundred. It's easier to have them in files I can just copy over with a usb stick if need arises. With perl scripts on the same stick I can do my things on practically any computer, I upload results to be seen online anyway.

As an employee of a well-known international advisory services company, I'm obliged to recommend to you that you store your Big Data in the cloud. ☺

Jim

In reply to Re^2: Append lines to csv by Jim
in thread Append lines to csv by stangoesagain

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.