|
PureBytes Links
Trading Reference Links
|
On Thursday, May 17, 2001, 12:42:07 PM, cwest@xxxxxxxxxxxx wrote:
cjn> Omega's single-precision math is pretty bad, but it shouldn't be
cjn> off by 4.8%.
It depends on the calculation. If the result depends on differences
between large numbers, for example, it can be waaaayyy off. I once had
a digital filter that was OK in double precision, but it was so far
off it crashed TS4 with a math overflow - a LOT more than 4.8%. :-)
ztrader
|