[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[amibroker] Floating point precision (or lack thereof)

PureBytes Links

Trading Reference Links

 
Hi all,

When i display values in commentary window like High, Low etc, I'm
seeing values which appear to be imprecise. For example, my downloaded
data contains a low of 38.78 for a particular bar, but when I display
the value in Commentary window to 8 decimal places i get:

L=38.77999878

This causes problems in backtesting because if i code this condition

IIF(L<38.78,X,Y)

the code will yield X when in fact it should yield Y because the low
is not less than 38.78 (it is exactly 38.78). This occurs simply
because of the imprecise representation of the value in AB.

Does anyone know how to get around this, and if its normal for the
value to be imprecise in AB?

Thanks a lot,
g





------------------------ Yahoo! Groups Sponsor --------------------~--> 
<font face=arial size=-1><a href="http://us.ard.yahoo.com/SIG=12hn93cka/M=362343.6886682.7839641.1493532/D=groups/S=1705632198:TM/Y=YAHOO/EXP=1124872158/A=2894354/R=0/SIG=11qvf79s7/*http://http://www.globalgiving.com/cb/cidi/c_darfur.html";>Help Sudanese refugees rebuild their lives through GlobalGiving</a>.</font>
--------------------------------------------------------------------~-> 

Please note that this group is for discussion between users only.

To get support from AmiBroker please send an e-mail directly to 
SUPPORT {at} amibroker.com

For other support material please check also:
http://www.amibroker.com/support.html

 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/amibroker/

<*> To unsubscribe from this group, send an email to:
    amibroker-unsubscribe@xxxxxxxxxxxxxxx

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/