[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [amibroker] Floating point precision (or lack thereof)



PureBytes Links

Trading Reference Links

Yes it caused problems getting charts like PF charts correct.
You can work around it by rounding up or down eg in you case 
an example  Round(L*100)/100
or
Unless you absolutely need accuracy past 5 digits, don't.


On 8/24/05, giggollo99 <giggollo@xxxxxxxxxxx> wrote:
> Hi all,
> 
> When i display values in commentary window like High, Low etc, I'm
> seeing values which appear to be imprecise. For example, my downloaded
> data contains a low of 38.78 for a particular bar, but when I display
> the value in Commentary window to 8 decimal places i get:
> 
> L=38.77999878
> 
> This causes problems in backtesting because if i code this condition
> 
> IIF(L<38.78,X,Y)
> 
> the code will yield X when in fact it should yield Y because the low
> is not less than 38.78 (it is exactly 38.78). This occurs simply
> because of the imprecise representation of the value in AB.
> 
> Does anyone know how to get around this, and if its normal for the
> value to be imprecise in AB?
> 
> Thanks a lot,
> g
> 
> 
> 
> 
> 
> 
> Please note that this group is for discussion between users only.
> 
> To get support from AmiBroker please send an e-mail directly to
> SUPPORT {at} amibroker.com
> 
> For other support material please check also:
> http://www.amibroker.com/support.html
> 
> 
> Yahoo! Groups Links
> 
> 
> 
> 
> 
> 
> 


-- 
Cheers
Graham
AB-Write >< Professional AFL Writing Service
Yes, I write AFL code to your requirements
http://e-wire.net.au/~eb_kavan/ab_write.htm


------------------------ Yahoo! Groups Sponsor --------------------~--> 
<font face=arial size=-1><a href="http://us.ard.yahoo.com/SIG=12hqb7m80/M=362131.6882500.7825259.1493532/D=groups/S=1705632198:TM/Y=YAHOO/EXP=1124873715/A=2889190/R=0/SIG=10r90krvo/*http://www.thebeehive.org
">Put more honey in your pocket. (money matters made easy) Welcome to the Sweet Life - brought to you by One Economy</a>.</font>
--------------------------------------------------------------------~-> 

Please note that this group is for discussion between users only.

To get support from AmiBroker please send an e-mail directly to 
SUPPORT {at} amibroker.com

For other support material please check also:
http://www.amibroker.com/support.html

 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/amibroker/

<*> To unsubscribe from this group, send an email to:
    amibroker-unsubscribe@xxxxxxxxxxxxxxx

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/