in reply to Re^3: Performance optimization question
in thread Performance optimization question

I get slightly different results: 

$ perl -le'
open D, q[/usr/share/dict/words] or die $!;
my $string = join "|", <D>;
use Benchmark qw/cmpthese/;
cmpthese -20, {
    orig => sub {
        my @arr = split /\|/, $string;
        my @arr1 = grep { /oug/ } @arr;
        return @arr1;
        },
    Buk1 => sub {
        my @arr1 = grep { /oug/ } split /\|/, $string;
        return @arr1;
        },
    jwkrahn => sub {
        my @arr1 = grep /oug/, split /\|/, $string;
        return @arr1;
        },
    Buk2 => sub {
        my @arr1 = $string =~ /(?:^|\|)(.*?oug.*?)(?=\||$)/g;
        return @arr1;
        },
    JOOST => sub {
        my @arr1 = $string =~ /(?:^|\|)([^|]*?oug[^|]*?)(?=\||$)/g;
        return @arr1;
        },
    };
'
          Rate   JOOST    Buk2    orig    Buk1 jwkrahn
JOOST   4.37/s      --    -10%    -13%    -38%    -67%
Buk2    4.87/s     11%      --     -4%    -31%    -63%
orig    5.05/s     15%      4%      --    -28%    -62%
Buk1    7.05/s     61%     45%     40%      --    -47%
jwkrahn 13.2/s    202%    171%    162%     87%      --

[download]
  YMMV   :-)

Replies are listed 'Best First'.
Re^5: Performance optimization question
by BrowserUk (Patriarch) on Apr 03, 2008 at 04:36 UTC
    YMMV :-)

    It did :)

    If you add a hits counter as in my benchmark above, you'll see the reason why. Buk2 does not match anything at all (and fails slowly) in your benchmark: 

    c:\test>junk6-b
          Rate    orig    Buk1   JOOST    Buk2 jwkrahn
orig    1.59/s      --    -30%    -55%    -59%    -63%
Buk1    2.29/s     44%      --    -36%    -41%    -47%
JOOST   3.57/s    125%     56%      --     -8%    -18%
Buk2    3.88/s    144%     70%      9%      --    -11%
jwkrahn 4.35/s    173%     90%     22%     12%      --
{ Buk1 => 203, Buk2 => 0, JOOST => 203, jwkrahn => 203, orig => 203 }
...............*********

    [download]

    And that intrigued me, until I noticed that you are not chomping your data. Once you chomp it, you'll find that Buk2 matches the same number as the others, and runs much (1100%) faster than grep: 

    c:\test>junk6-b
          Rate    orig    Buk1   JOOST jwkrahn    Buk2
orig    1.59/s      --    -29%    -59%    -64%    -97%
Buk1    2.23/s     40%      --    -42%    -49%    -96%
JOOST   3.84/s    141%     72%      --    -12%    -93%
jwkrahn 4.37/s    175%     96%     14%      --    -92%
Buk2    53.0/s   3231%   2280%   1281%   1113%      --
{ Buk1 => 203, Buk2 => 203, JOOST => 203, jwkrahn => 203, orig => 203 
+}

    [download]

    Alternatively, just add /s to the regex in Buk2 in your benchmark, and it will also allow Buk2 to work, but it will only be 500% faster. 

    c:\test>junk6-b
          Rate    orig    Buk1   JOOST jwkrahn    Buk2
orig    1.59/s      --    -30%    -55%    -63%    -94%
Buk1    2.27/s     43%      --    -36%    -48%    -92%
JOOST   3.54/s    122%     56%      --    -18%    -88%
jwkrahn 4.33/s    172%     91%     22%      --    -85%
Buk2    28.5/s   1693%   1155%    707%    559%      --
{ Buk1 => 203, Buk2 => 203, JOOST => 203, jwkrahn => 203, orig => 203 
+}

    [download]
    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.
[reply]
[d/l]
[select]

In Section Seekers of Perl Wisdom