The reason your multi-loop (1000 in the i loop, 1000 in the j, and 100 in the k) doesn't change behavior is because that is equivalent to a single loop of 1e8 elements. The perl time is behaving linearly, as we keep saying. One thousand loops takes 1000 times as long as one loop; one million loops takes 1000 times as long as one thousand loops. A hundred million takes 100 times as long as one million. That's the nature of a loop.

To add more mods for you to try, to better understand what's going on with perl's linearity: If you want to be able to explore your data and zoom into different ranges, still keeping the linear axis, change to 

    my $ubound = 1e7;   # set this to change the upper bound for graph
+ing; [choroba]'s would be 1e8.
    print {$gp} join "\n", 'set term png;',
                           'set output "measure.png";',
                           'set key left;',
    #                      'set logscale x;',
                           "set xrange [10:$ubound]",
                           ;

[download]
where you can now edit the $ubound value to change where you zoom in to.

Also, a couple lines down from the block above, change with lines to with linespoints to get it to draw points as well as lines.

Finally, let's change the main for loop to the following. This will add a perfectly linear set of data as well.

    for my $n (10, 100, 1e3, 1e4, 1e5, 1e6, 2.5e6,
               5e6, 7.5e6, 1e7, 2.5e7, 5e7, 7.5e7, 1e8
    ) {
        print STDERR "$n\n";
        for my $lang (sort keys %run) {
            $time{$n}{$lang} = measure($run{$lang}, $n, prepare($lang,
+ $n));
        }
        $time{$n}{linear} = 7e-8 * $n + 1e-6;       # [pryrt] added th
+is perfect mathematical line: y = mx + b  # Anonymous Monk should use
+ 7e-7 instead of 7e-8
    }
    $run{linear} = undef;                           # [pryrt] added so
+ that plot() below will include 'linear'

[download]

For example, on my system, with $ubound = 1e7 and linespoints, see https://i.imgur.com/y04W8f5.png for a side-by-side of logscale-x and linear-x, and noticing that there is data below "1x106" (1e6) on the linear-x graph -- it's just hard to see because it's all overlapping. (I also included the complete data set to 1e8 on both logscale and linear-scale)

When I do this, the perl graph looks linear. The C graph is mostly flat, implying that either the setup time for c is dwarfing its per-loop time, or the c compiler has optimized out the dummy s+=i;, since the result was never used.

Since you keep saying there's a "1MB limit" (which, as I already said, is incorrect notation; we aren't dealing with bytes): look at my graphs. Where do you see this limit at 1e6 (1.0x106)? I see a reasonably-straight line. It's not perfectly straight, like y=mx+b, but very little in the real world is. And I picked my y=mx+b slope to match the data you've shown1, not to match my data, so there are different slopes between the my perl and the math-line. But as someone who looks at real world electronics measurements for a living, I would call that perl data "a straight line".

1: oops, no, it's off by a factor of 10, sorry; I should have used a slope of 7e-7, not 7e-8, to get ~70sec at n=1e8, sorry.

In reply to Re^8: perl process slower and slower when loop number increase by pryrt
in thread perl process slower and slower when loop number increase by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.