[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: Precision Errors



PureBytes Links

Trading Reference Links

Here is a perfecy example of someone who does not understand what is math
precision, and confuses number of digits and precision carried during a math
operation.

The above result is perfectly correct and do not lose precision at all.
A= 1,000,000,000 is known with 10 digits

B= 0.000111111111111 to be added is known with 12 digits.

Maybe you expet by adding both that the result shoud display A+B=
1,000,000,000.000111111111111, means 26igits!
This should be the case IF 1,000,000,000 was knows with 26 digits.
In this case A should write 1,000,000,000.000000000000000 to carry the
neessary precision.
But this is not the case, so your example is dead wrong.

Again , my hint is that most of you should read an elementary physics book
before whining on Float precision.

Sincerely,

Pierre Orphelin
www.sirtrade.com
TradeStation Technologies representative in France



> -----Message d'origine-----
> De : Kent Rollins [mailto:kentr@xxxxxxxxxxxxxx]
> Envoyé : dimanche 22 juillet 2001 00:25
> À : OmegaList
> Objet : Re: Precision Errors
>
>For example, if you add 0.000111111111111 to 1,000,000,000 you
> might end up with something like 1,000,000,000.1.
>
> These are extreme examples but this is how precision is lost
> across repeated math operations.
>