[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

First calculation problem



PureBytes Links

Trading Reference Links

List,

Well, I decided to do a little more work and discovered my first problem.

Somehow, MS came up with the following:

	     1486.20
- 1469.40
          16.7999 instead of the more commonly expected 16.80

Now the first number is the Close and the second number is the day's low, so
we can't blame this on any previous calculation or anything left over from
something else.  Well, that's not quite true.  The Low used in the
calculation was the result of an IF() statement that made sure that the Low
was really the Low by our definition (by checking it against the previous
day's Close).

What internal methodology might cause this excellent bit of subtraction?

Granted, in checking out the 170-member dataset, I didn't check them all.  I
checked the first 20 and the last 20.  Now I'll probably have to go back and
sample some in the middle.

I used my trusty, solar powered calculator to double-check my Clipper output
and they both agree that MS is wrong.  Any suggestions?

This is making me very nervous and might force me back to Excel and/or VB.
So far I've spent over two week on this relatively simple program and I have
to admit that I never thought it would be necessary to go back and
double-check such basic arithmetic.


Guy

Never be afraid to try something new. Remember, amateurs built the ark,
professionals built the Titanic.