Beefy Boxes and Bandwidth Generously Provided by pair Networks
There's more than one way to do things
 
PerlMonks  

Re: No More Meaningless Benchmarks!

by davido (Cardinal)
on Dec 09, 2006 at 02:36 UTC ( [id://588752]=note: print w/replies, xml ) Need Help??


in reply to No More Meaningless Benchmarks!

Mark Twain said "There are three types of lies; lies, damn lies, and statistics."

Unfortunately the world is dumbed-down enough that people can easily be bamboozled by stats. Just reflect on advertising slogans and claims (a few contrived examples):

  • "50% more vitamins than..." (Yes, but if X is Coke, and Y is Coke with a droplet of lemon juice in it, is 50% more actually significant? No.
  • "Your risk of contracting (name your disease) is ten times greater if you eat pistachios." (Yes, but if the risk without pistachios is one in 50,000,000, who cares if your modified risk is 1:5,000,000? You're still more likely to die of a car wreck.)
  • "Indexing a hash is twice as slow as indexing an array." Yes, but both are O(1) operations, which means if you're trying to optimize you might just want to look at the greater algorithm in which you're performing these lookups. If you actually care about the time differential, you might need to ask yourself why, and how you might eliminate the question in the first place.

What people often don't get is the concept of statistical significance. ...and relative significance (which is related). Teaching that is beyond the scope of this node. ;)


Dave

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://588752]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others chilling in the Monastery: (2)
As of 2024-04-19 00:59 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found