Re: Re: Re: Benchmark Arena Proposal

In any case, while I do find Perl vs. Perl benchmarks most amusing, all a benchmark will tell you is how fast a given platform can run the benchmark!

I disagree. A good benchmark should *compare* 2 or more things, not to see how fast either runs, but to see how they run relative to each other.

In this case Doug compares Perl to lots of other scripting languages - all on the same platform, and where possible, under the same conditions. The results are valid for seeing a lot more than how fast (in raw speed) something is.

Tony

Comment on Re: Re: Re: Benchmark Arena Proposal

Replies are listed 'Best First'.
Re: Re: Re: Re: Benchmark Arena Proposal by Albannach (Monsignor) on Jan 31, 2001 at 20:25 UTC
Oh, a good benchmark? ;-) OK, I'll admit I was being a bit flippant there. I'll agree with you if you add that the test must use real world data and real conditions as much as possible, but I just don't know how often that level of effort is made. In this case Doug compares Perl to lots of other scripting languages - all on the same platform, and where possible, under the same conditions. The results are valid for seeing a lot more than how fast (in raw speed) something is. I did read the page and know what he's comparing, but I still don't see what broader insights can be gained from these statistics. I'm not saying they are not interesting, but I sure wouldn't pick a language based on these results alone. Can you elaborate a bit on what you think the results show? If you compare languages or platforms using the more traditional benchmarks which are often highly idealized and optimized little exercises that have little to do with a real world use, you'll be able to say which ones run the benchmark the fastest, but not which one is better for a particular application (unless you have thoroughly profiled that application and know the appropriate weights to insert in the scorecard page or equivalent). -- I'd like to be able to assign to an luser	[reply]

Replies are listed 'Best First'.

Re: Re: Re: Re: Benchmark Arena Proposal
by Albannach (Monsignor) on Jan 31, 2001 at 20:25 UTC

good

In this case Doug compares Perl to lots of other scripting languages - all on the same platform, and where possible, under the same conditions. The results are valid for seeing a lot more than how fast (in raw speed) something is.

I did read the page and know what he's comparing, but I still don't see what broader insights can be gained from these statistics. I'm not saying they are not interesting, but I sure wouldn't pick a language based on these results alone. Can you elaborate a bit on what you think the results show?

If you compare languages or platforms using the more traditional benchmarks which are often highly idealized and optimized little exercises that have little to do with a real world use, you'll be able to say which ones run the benchmark the fastest, but not which one is better for a particular application (unless you have thoroughly profiled that application and know the appropriate weights to insert in the scorecard page or equivalent).

--
I'd like to be able to assign to an luser

[reply]