Re^4: [s]printf %d oddity

Ok, well since I've had to do most of my financial calculations in PL/SQL in the past since I was dealing with Oracle Financials, I thought I'd try it out:

create or replace function test return varchar2 as
begin
  if (8.78 * 100 = 878) then
     return 'ok';
  end if;
  return 'not ok';
end;
/
[download]

SQL> select test from dual;

TEST
-------------------------------------------------------------------
ok
[download]

They're dealing with binary and decimal conversions. Now granted, I've had to deal with rounding errors in the past, but not for trivial calculations like the one above. I still contend that in this example, where we're not dealing with repeating numbers, that a language should be able to get it right

Comment on Re^4: [s]printf %d oddity Select or Download Code

Replies are listed 'Best First'.
Re^5: [s]printf %d oddity by Joost (Canon) on May 20, 2005 at 11:45 UTC
Sure it would be nice if this would always work, but that's why it's recommended to always use sprintf() to round before comparing if you're working with floating point numbers. You won't know when it will break otherwise. Keep in mind that perl uses the underlying C compiler's native float. By the way, how do you know that 8.78 isn a ~~repeating~~ finite number in binary? On my machine: `#!/usr/local/bin/perl -w use strict; my $x = pack("F",8.78); print(unpack("B",$x)); __OUTPUT__ 1000111111000010111101010010100001011100100011110010000101000000` [download] Now, if I only knew which part was what :-) updated:* s/8.98/8.78/ "What should it profit a man, if he should win a flame war, yet lose his cool?"	[reply] [d/l]
Re^5: [s]printf %d oddity by Anonymous Monk on May 20, 2005 at 11:24 UTC
Trivial? That would be some assembler	[reply]