See What Every Computer Scientist Should Know About Floating-Point Arithmetic for copious gory details.

(I thought we had a tutorial on this lying around somewhere. Couldn't find it.)   Update: BrowserUk's post was probably what I was thinking of.