Why are you thinking that it's surprising? Floats can't represent anything that isn't a fraction of two (1/2, 1/4, 1/8, and so on) so since you've chosen a number that's unrepresentable, you're going to get bad results.

Just one more good reason to not use IEEE floating point numbers to represent money...