[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[amibroker] Re: Detecting data mining bias with modified Monte Carlo procedure



PureBytes Links

Trading Reference Links

Thanks to all.

Last year QT posted a simple Ami method that is similar to *MCP + 
random entry* as a benchmark.

OT: Statistics #103009

BrianB2

--- In amibroker@xxxxxxxxxxxxxxx, "whitneybroach" <WhitneyBroach@xxx> 
wrote:
>
> While reading David Aronson's book _Evidence-based Technical
> Analysis_, I stumbled across a modified Monte Carlo permutation
> (MCP) procedure that compensates for data mining bias, assuming that
> the "best" permutation of rules was not selected with a directed 
search.
> 
> From Aronson's perspective, this is good news.  He views data mining
> as a useful procedure in the discovery phase of research.  Plus, MCP
> does not require out-of-sample data.  Thus it is possible to use 
more
> data for mining and still minimize data mining bias in test 
results. 
> The likely result:  fewer false positives for systems that are
> worthless, and fewer false negatives for systems that are valuable.
> 
> The paper with discussion and C# code is here:
> <http://www.evidencebasedta.com/MonteDoc12.15.06.pdf>.
> 
> Aronson's book site, including a link to Amazon, is:
> <http://www.evidencebasedta.com>.  Separately, I'm looking forward 
to
> the imminent books from Howard
> <http://www.quantitativetradingsystems.com/> and Ralph Vince
> <http://tinyurl.com/2os2p7>.
> 
> Not being a user of IO (or other AB add-ons), I have no idea if this
> MCP approach is already being used in the AB community.  It looks
> interesting to me.  MCP appears to require market data and trade 
data
> from every run, not simply the trade data.  That suggests to me that
> an AB add-on, rather than a completely external program, would be a
> more straightforward implementation.
> 
> Aronson also refers to a patented boostrap procedure that 
accomplishes
> much the same thing, White's Reality Check, named for Halbert White,
> the patent holder.  Apparently WRC is not available commercially.
> 
> Best,
>




------------------------ Yahoo! Groups Sponsor --------------------~--> 
Transfer from your equities account.  
Receive up to $1,000 from GFT. Click here to learn more.
http://us.click.yahoo.com/aZttyC/X_xQAA/cosFAA/GHeqlB/TM
--------------------------------------------------------------------~-> 

Please note that this group is for discussion between users only.

To get support from AmiBroker please send an e-mail directly to 
SUPPORT {at} amibroker.com

For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
http://www.amibroker.com/devlog/

For other support material please check also:
http://www.amibroker.com/support.html
 
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/amibroker/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/amibroker/join
    (Yahoo! ID required)

<*> To change settings via email:
    mailto:amibroker-digest@xxxxxxxxxxxxxxx 
    mailto:amibroker-fullfeatured@xxxxxxxxxxxxxxx

<*> To unsubscribe from this group, send an email to:
    amibroker-unsubscribe@xxxxxxxxxxxxxxx

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/