[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: Floating point



PureBytes Links

Trading Reference Links

It doesn't depend on how many decimal places; it depends on how many
significant figures there are in the data values.

So for example, doing calculations on a stock under $10.00 will use a
maximum of 3 to 4 signiciant figues.  Single precision should be adequate
for that.

What do you do with an index whose data is over the 10,000 pt. range i.e.
like the DJ Industrials?  That data already uses 7 significant figures i.e.
10,156.95.  Intermediate calculations can quickly run into the 8, 9, or 10
figure ranges which get truncated off in single-precision.  Wouldn't you
like to have reliable calculations when working with index data?


-----Original Message-----
From: Patrick Gamble [mailto:pgamble@xxxxxxxxx]
Sent: July 29, 2001 7:49 AM
To: Omega-list
Subject: Floating point

If the data is accurate to, say, two decimal places, then
it is useless functionality to be able to deal with that data
to six places. The data that Tradestation deals with is
often not even accurate to two places.