You need to profile your code to see where it's spending the most time. Once you've done that, the solution will probably be obvious to you, but if it isn't, people here will be happy to help provided that you supply all the necessary information.

However, it is my experience that when it comes to crunching text files in perl the bottleneck is in reading and writing the disk even when my perl code is really crufty. In which case the solution is to buy faster disks, with bigger caches, and arrange them so that they can be read in parallel without saturating the various buses. Your sysadmin will be happy to help with this. Note that you can read/write disks in parallel without having to parallelise your code. I leave figuring out how as an exercise for your sysadmin and operating system vendor.


In reply to Re: Simultaneously process the multiple files at the same time by DrHyde
in thread Simultaneously process the multiple files at the same time by senthil_v

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.