Hi

quick question , is there a faster alternative for the push and shift function on the following code:

my @a =(); my @b =(); while(<IN>){ chomp; $cnt++; /\d+\t(\d+)/; if (@a<7){ push(@a,$1); } push(@b,$1) if $1 > 3; if (@b>7){ shift(@a); shift(@b); } print $a[0] - $b[-1] . "\n" }
the reason i'm asking is because if i just iterate through file IN like :
while(<IN>){ $cnt++ }
it takes me 10 min and if a complicate it with 2 push and shift functions, plus regex, the runtime increases to 150 min

cheers

baxy

Update:

ok so more details , though i think they are irrelevant:

file size: 70GB file format : tsv 1 34 2 6 3 78 simple while-loop time: real 10m51.378s user 9m22.610s sys 0m13.120s while loop with regex + push and shift + one subtraction(i forgot to m +ention that) real 157m13.245s user 152m8.520s sys 1m26.660s

In reply to Faster push and shift by baxy77bax

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.