in reply to Re^3: Need more precision.
in thread Need more precision.
This is what is tickling the back of my brain; but I'm stuck as to how to implement it?
As an example of when I run out of precision: I have the value: 0.0000000045 that I have to multiply by itself: 0.00000000000000002025 which becomes 0.0000000000000000 with doubles.
I'm thinking about something along the lines of storing that as: [-10, 45]; multiply it by itself and I get [-20, 2025].
Using a single byte for the fixed point will get me down to +-1e-127 which is probably more than enough to be going on with.
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re^5: Need more precision.
by talexb (Chancellor) on Jun 10, 2015 at 14:45 UTC | |
by BrowserUk (Patriarch) on Jun 10, 2015 at 20:00 UTC | |
|
Re^5: Need more precision.
by RonW (Parson) on Jun 10, 2015 at 17:55 UTC | |
by BrowserUk (Patriarch) on Jun 10, 2015 at 19:49 UTC | |
|
Re^5: Need more precision.
by RonW (Parson) on Jun 10, 2015 at 19:09 UTC | |
by BrowserUk (Patriarch) on Jun 14, 2015 at 13:18 UTC | |
by RonW (Parson) on Jun 15, 2015 at 18:31 UTC |