Re: Decimal precision issue: Windows vs. Unix

Replies are listed 'Best First'.
Re^2: Decimal precision issue: Windows vs. Unix by JavaFan (Canon) on Jan 09, 2009 at 22:14 UTC
$ echo '( -95.3009707988281 + -95.1877600585938 ) / 2' \| bc -l -95.24436542871095000000 $ [download] It seems that both -95.2443654287109 and -95.244365428711 are both approximation, with exactly the same error. It's just that one library decides to round down, the other up.	[reply] [d/l]
Re^2: Decimal precision issue: Windows vs. Unix by ikegami (Patriarch) on Jan 09, 2009 at 22:03 UTC
eh? Why do you say that? They're the same number.	[reply]
Re^2: Decimal precision issue: Windows vs. Unix by Lawliet (Curate) on Jan 09, 2009 at 22:23 UTC
It was a joke :\ I find it funny because most fanboys will find any little thing they can to trump their opponent. In this case it was how the library rounds, or, rather, how far out it rounds. Update: :P @ anonny's reply And you didn't even know bears could type.	[reply]
Re^3: Decimal precision issue: Windows vs. Unix by Anonymous Monk on Jan 10, 2009 at 07:42 UTC
Please keep your jokes to the joke forum and joke threads :\| esp. if they're all this funny :\|	[reply]