[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: TS 5.0 Numerical Precision?



PureBytes Links

Trading Reference Links

> fails in my 5.0
> 
> Miles Dunbar
> 
> -----Original Message-----
> 
> var: x(0);
> x = 1.000000000015 - 1.000000000010;
> if x = .000000000005 then plot1(x,"pass") else plot2(x,"fail");

That's a pity.  I have certainly run into precision limits in the past.

Thanks for the test, it was appreciated.

Chris Norrie