in reply to what did I just see..?
Welcome to the world of floating point arithmetic!
Short version: 0.01 can not be represented exactly as a floating point number, there's a tiny error here. Since you always subtract the same number, this error accumulates to the point where the difference shows up.
Long version: What Every Programmer Should Know About Floating-Point Arithmetic.
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re^2: what did I just see..?
by Anonymous Monk on Mar 22, 2021 at 04:47 UTC |