in reply to Re: OT: How much float precision needed for operation?
in thread OT: How much float precision needed for operation?
I did find this link to a pdf discussing estimation of required significant digits, and I think it very likely applicable to my question, but the paper is far enough above my head that I'm unable to use that link without further assistance.
-Scott
Update: Ack, I hadn't seen trammell's post below when I posted this, I'm studying it now...
|
|---|