[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[amibroker] Re: Floating point precision (or lack thereof)



PureBytes Links

Trading Reference Links

Thanks for the ROUND tip. I missed that 1st time around, sure does
clean up som charts. <G>

jk

--- In amibroker@xxxxxxxxxxxxxxx, Graham <kavemanperth@xxxx> wrote:
> Yes it caused problems getting charts like PF charts correct.
> You can work around it by rounding up or down eg in you case 
> an example  Round(L*100)/100
> or
> Unless you absolutely need accuracy past 5 digits, don't.
> 
> 
> On 8/24/05, giggollo99 <giggollo@xxxx> wrote:
> > Hi all,
> > 
> > When i display values in commentary window like High, Low etc, I'm
> > seeing values which appear to be imprecise. For example, my downloaded
> > data contains a low of 38.78 for a particular bar, but when I display
> > the value in Commentary window to 8 decimal places i get:
> > 
> > L=38.77999878
> > 
> > This causes problems in backtesting because if i code this condition
> > 
> > IIF(L<38.78,X,Y)
> > 
> > the code will yield X when in fact it should yield Y because the low
> > is not less than 38.78 (it is exactly 38.78). This occurs simply
> > because of the imprecise representation of the value in AB.
> > 
> > Does anyone know how to get around this, and if its normal for the
> > value to be imprecise in AB?
> > 
> > Thanks a lot,
> > g
> > 
> > 
> > 
> > 
> > 
> > 
> > Please note that this group is for discussion between users only.
> > 
> > To get support from AmiBroker please send an e-mail directly to
> > SUPPORT {at} amibroker.com
> > 
> > For other support material please check also:
> > http://www.amibroker.com/support.html
> > 
> > 
> > Yahoo! Groups Links
> > 
> > 
> > 
> > 
> > 
> > 
> > 
> 
> 
> -- 
> Cheers
> Graham
> AB-Write >< Professional AFL Writing Service
> Yes, I write AFL code to your requirements
> http://e-wire.net.au/~eb_kavan/ab_write.htm




------------------------ Yahoo! Groups Sponsor --------------------~--> 
<font face=arial size=-1><a href="http://us.ard.yahoo.com/SIG=12hdtqpgq/M=362343.6886682.7839641.1493532/D=groups/S=1705632198:TM/Y=YAHOO/EXP=1124900890/A=2894354/R=0/SIG=11qvf79s7/*http://http://www.globalgiving.com/cb/cidi/c_darfur.html";>Help Sudanese refugees rebuild their lives through GlobalGiving</a>.</font>
--------------------------------------------------------------------~-> 

Please note that this group is for discussion between users only.

To get support from AmiBroker please send an e-mail directly to 
SUPPORT {at} amibroker.com

For other support material please check also:
http://www.amibroker.com/support.html

 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/amibroker/

<*> To unsubscribe from this group, send an email to:
    amibroker-unsubscribe@xxxxxxxxxxxxxxx

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/