in reply to Re: Comparing results of math operations
in thread Comparing results of math operations
But does switching to decimal floats solve all problems?
1/3 can't be represented loss-free in neither decimal nor binary floats (3 is not a primefactor of 10 or 2)
So (1/3 * 3) can be different to 1.
Though it isn't ATM
DB<125> 1/3 *3 <=> 1 => 0
I'm not sure if that's always the case for similar calculations.
I remember similar discussions talking about something like "symbolic calculations", where divisor and denominator are kept separate till the end.
Cheers Rolf
( addicted to the Perl Programming Language)
|
---|
Replies are listed 'Best First'. | |
---|---|
Re^3: Comparing results of math operations
by syphilis (Archbishop) on Apr 16, 2014 at 14:14 UTC | |
Re^3: Comparing results of math operations
by choroba (Cardinal) on Apr 16, 2014 at 13:44 UTC | |
by LanX (Saint) on Apr 16, 2014 at 14:03 UTC |