RE: TS 5.0 Numerical Precision?

["Joseph Biran" <j.biran@xxxxxxxxxxxxx>]

I am afraid the suggested test fails to prove the point.
The reason being that if the result in the first line of code is:

x = .000000000005000001... or
x = .000000000004999999...

in condition the second line of code will fail.

A better way to prove this would be to replace the second line
with:

if absvalue(x - .000000000005) > 0 then plot1(x,"pass") else
plot2(x,"fail");

 
Joseph Biran
________________________________________________


-----Original Message-----
From: Chris Norrie [mailto:chris@xxxxxxxx]
Sent: Tuesday, September 22, 1998 9:45 AM
To: omega-list@xxxxxxxxxx
Subject: RE: TS 5.0 Numerical Precision?


> fails in my 5.0
>
> Miles Dunbar
>
> -----Original Message-----
>
> var: x(0);
> x = 1.000000000015 - 1.000000000010;
> if x = .000000000005 then plot1(x,"pass") else plot2(x,"fail");

That's a pity.  I have certainly run into precision limits in the
past.

Thanks for the test, it was appreciated.

Chris Norrie