A variant of the Test:Harness should be able to do this. If submitteers just provide the snippet of code, then the harness can do all the timing, generate statistics and ensure common test files, etc.
There are also some subtleties between improvements in speed derived from better algorithms and those derived from implementing the same algorithm better.

For example one race could be "Write a fast quicksort routine", vs. "write a fast sort routine". In the first case, the winner will be the one who programs the algorithm best, in the latter case it will be the one who comes up with the algorithm best suited to the data.

In some cases, whether the test data is given with the challenge will be important to the outcome.

Re: machine variations: I wouldn't expect the machine variation to matter as much as the algorithm / coding variation. I.e. the fastest algorithm one one machine is likely to be the fastest on any machine.
--
Brovnik.

In reply to Re: Re: Another golf style? by Brovnik
in thread Another golf style? by jynx

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.