in reply to Inconsistent Results with Benchmark

When benchmarking, you need to collect a large number of "observations" under varying and trying-to-be-realistic conditions, then do summary statistics on the dataset of results. Any one single observation might be skewed.
  • Comment on Re: Inconsistent Results with Benchmark

Replies are listed 'Best First'.
Re^2: Inconsistent Results with Benchmark
by Anonymous Monk on Dec 08, 2014 at 22:23 UTC
    Any one single observation might be skewed.

    Which is why Benchmark already runs many iterations to generate its statistics.