in reply to Re: Converting -4.84800000E+001 to -48.48 doesn't work... but 48.49 does
in thread Converting -4.84800000E+001 to -48.48 doesn't work... but 48.49 does
-48.48 is being assigned correctly, but -4.848e1 is off by one ulp.C:>perl -le "print scalar reverse unpack 'h*', pack 'd<', -48.48;" c0483d70a3d70a3d C:>perl -le "print scalar reverse unpack 'h*', pack 'd<', -4.848e1;" c0483d70a3d70a3e
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re^3: Converting -4.84800000E+001 to -48.48 doesn't work... but 48.49 does
by Anonymous Monk on Jan 06, 2017 at 00:39 UTC | |
by syphilis (Archbishop) on Jan 06, 2017 at 03:37 UTC | |
by tye (Sage) on Jan 07, 2017 at 19:06 UTC | |
by syphilis (Archbishop) on Jan 07, 2017 at 23:38 UTC |