Dear fellow monks,

I got a new programming task at work now, and wonder what is the best language/platform to code it in.

The task consists mostly of reading huge binary files (~100 MB), divided to 128 bit chunks, and raving through this heap of bits looking for certain patterns, and validating some information. An additional need is doing some ASCII file work, comparing things, reporting things and reading configurations. There's also have to be some GUI.

My main concern with Perl is speed. I fear that processing binary data in Perl is not fast enough to accomplish the tasks in some normal time. Therefore, I also consider C. But the argument against C is that I'll have to code a GUI (Perl/Tk) and do some text file processing, in which Perl is definitely superior.

If I'll choose Perl eventually, are there any good advice for me ? Any useful CPAN modules ? How is it best to handle 128 bit binary frames in Perl ? How is it best to read such a file ? All of it to memory ? But how ?

Hoping for insights and advices :-)

In reply to is perl the best tool for this job ? by spurperl

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.