Perl can be faster at reading than C using stdio. I haven't timed C++ using std:: I/O against C's stdio nor against Perl's I/O, so I can't say for sure, but I suspect that Perl can be faster than C++. Unfortunately, Perl for Linux is not properly optimized and so Perl's <STDIN> is about four-times slower than it should be.

Now, if the analysis required building data structures whose complexity was a function of the size of the log file, then I'd definitely have doubts about being able to do the analysis easily in Perl without running out of swap space (and running at a snail's pace before failing due to excessive page faulting). (Perl has a strong preference to consuming RAM in order to improve execution speed.) But that seems a very unlikely type of analysis.

So I'd have a very strong preference for doing this stuff in Perl unless you can dig up a more concrete reason why Perl isn't appropriate. A terrabyte log file in itself isn't a reason to not use Perl.

        - tye (but my friends call me "Tye")

In reply to (tye)Re: Perl vs C++ by tye
in thread Perl vs C++ by reyjrar

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.