|
PureBytes Links
Trading Reference Links
|
Having a bit of trouble designing a simple parser to extract values from a csv file. My code only seems to work for some cases, but not others, and I can't seem to figure out why.
I have a csv log file with three columns: FastMa, SlowMA, %Winners:
11,100,32
22,100,35
31,100,36
43,100,37
52,100,38
23,125,32
32,125,35
44,125,36
53,125,48
12,150,31
25,150,33
34,150,32
46,150,35
54,150,36
26,175,31
36,175,34
47,175,34
55,175,36
27,200,29
37,200,33
48,200,34
57,200,36
If I want to extract the value of the FastMA that corresponds to the largest %Winner, the following code works correctly and prints the value "53":
//------------------------------------------------------------------------------
// PARSER VERSION 1: Find value of FastMA that corresponds to largest %Winners
//------------------------------------------------------------------------------
fh = fopen( "C:\\logFile2.txt", "r" );
FinalFast = WinsPct = WinTest = fast = slow = 0;
if(fh)
{
Line1 = fgets(fh);
WinsPct = StrToNum( StrExtract(Line1,2) );
WinTest = WinsPct; // initialize WinTest
while( !feof(fh) )
{
Line1 = fgets(fh);
fast = StrToNum( StrExtract(Line1,0) );
slow = StrToNum( StrExtract(Line1,1) );
WinsPct = StrToNum( StrExtract(Line1,2) );
FinalFast = IIf(WinsPct > WinTest, fast, FinalFast);
_TRACE("FinalFast"+FinalFast);
WinTest = IIf(WinsPct > WinTest, WinsPct, WinTest);
_TRACE("WinTest"+WinTest);
}
}
fclose(fh);
printf(NumToStr(FinalFast) );
But if I want to extract the value of the FastMA that corresponds to the smallest %Winners, and simply change all ">" to "<", the code should work. But it doesn't. Intead of printing "27", it prints "0". Why are the values being reset to initialization, when it did not happen with the case above? Below is the code. As mentioned, the only trivial difference are the inequalities. Otherwise, it's identical to the above.
Any feedback much appreciated.
//------------------------------------------------------------------------------
// PARSER VERSION 2: Find value of FastMA that corresponds to smallest %Winners
//------------------------------------------------------------------------------
fh = fopen( "C:\\logFile2.txt", "r" );
FinalFast = WinsPct = WinTest = fast = slow = 0;
if(fh)
{
Line1 = fgets(fh);
WinsPct = StrToNum( StrExtract(Line1,2) );
WinTest = WinsPct; // initialize WinTest
while( !feof(fh) )
{
Line1 = fgets(fh);
fast = StrToNum( StrExtract(Line1,0) );
slow = StrToNum( StrExtract(Line1,1) );
WinsPct = StrToNum( StrExtract(Line1,2) );
FinalFast = IIf(WinsPct < WinTest, fast, FinalFast);
_TRACE("FinalFast"+FinalFast);
WinTest = IIf(WinsPct < WinTest, WinsPct, WinTest);
_TRACE("WinTest"+WinTest);
}
}
fclose(fh);
printf(NumToStr(FinalFast) );
--- In amibroker@xxxxxxxxxxxxxxx, "ozzyapeman" <zoopfree@xxx> wrote:
>
> My bad. I had changed the location of the file in one area of the code
> and neglected the other.
>
> It works.
>
> Thanks a bunch!!
>
>
>
> --- In amibroker@xxxxxxxxxxxxxxx, "ozzyapeman" zoopfree@ wrote:
> >
> > Awesome, Mike. That's exactly the type of thing I was looking for.
> >
> > One problem, though. I try to run your code and only the column
> > titles, "Fast,Slow,PCTWin" get written to the file. The actual values
> > are not getting written, despite the fact that my optimization reports
> > shows many values corresponding to % winners > 60.
> >
> > Looking at the trace output indicates the number of triggers are being
> > properly hit. Your code also appears to be quite straightforward, and
> > I cannot spot any obvious bug.
> >
> > Did you try running this? Does it work for you? Any idea where the bug
> > might be?
> >
> >
> >
> > --- In amibroker@xxxxxxxxxxxxxxx, "Mike" <sfclimbers@> wrote:
> > >
> > > AddToComposite is for storing values on a bar by bar basis. I don't
> > > think that this would be the right approach for your goals, since you
> > > are looking for a single scaler value representing total
> performance for
> > > a given period. Yes, you could write scripts to dig out the
> performance
> > > metrics and persist the subset of interest. However, it would be
> easier
> > > to just track the interesting ones as they occur. The following
> AFL can
> > > be run through the Optimizer and persist in a separate file the
> > > parameter values for only those backtests that were of interest. I'll
> > > leave the digging out of values in the second AFL to you, as it sounds
> > > like you have an idea already of how you want to do that. Mike
> > > fast = Optimize("Fast", 10, 10, 50, 10); slow = Optimize("Slow", 100,
> > > 100, 200, 25);
> > > Buy = Cross(MA(Close, fast), MA(Close, slow)); Sell = Cross(MA(Close,
> > > slow), MA(Close, fast));
> > > SetCustomBacktestProc("");
> > > if (Status("ActionEx") == actionExOptimizeSetup) {
> > > _TRACE("Optimize Begin"); fh =
> > > fopen("C:\\temp\\logFile.csv", "w");
> > > if (fh) { fputs("Fast,Slow,PCTWin\n", fh);
> > > fclose(fh); } }
> > > if (Status("action") == actionPortfolio) { _TRACE("Portfolio
> > > Backtest"); bo = GetBacktesterObject(); bo.Backtest();
> > > stats = bo.GetPerformanceStats(0); pctWinners =
> > > stats.getValue("WinnersPercent");
> > > if (pctWinners > 60) { _TRACE("Trigger"); fh =
> > > fopen("C:\\temp\\logFile.csv", "a");
> > > if (fh) {
> > > fputs(StrFormat("%f,%f,%f\n", fast, slow, pctWinners), fh);
> > > fclose(fh);
> > > } }
> > > } --- In amibroker@xxxxxxxxxxxxxxx, "ozzyapeman" <zoopfree@> wrote:
> > > >
> > > > Sorry if I was not clear enough. I will try to give more details.
> > > >
> > > > Basically I want to run an optimization on two variables, then
> > > > somehow, automatically, store all values of optimized variables that
> > > > correspond to a certain metric range (let's say %Winners > 60).
> > > > Another AFL would then pull that range of optimized variables for a
> > > > backtest.
> > > >
> > > > I would use the Walk Forward feature of AmiBroker for this,
> except it
> > > > only uses the 'best' value, not a range of values. My system
> requires
> > > > a range of values, not just the best one. I also want to permanently
> > > > store the best values.
> > > >
> > > > I am stuck trying to figure out how to automatically pull the
> > > > optimized variables from the optimization report. The custom
> > > > backtester only allows me to pull the built-in metrics.
> > > >
> > > > So the basic question is - how do I extract the optimized variables
> > > > after an optimization is run? Do I have to write some _vbscript_ that
> > > > exports the report to csv, then opens that report, then somehow
> parses
> > > > through that report to find the correct column and range? Or is
> there
> > > > (hopefully) a simpler way of extracting the values?
> > > >
> > > > Once the values are extracted, it is then fairly easy to either
> write
> > > > them to a file or store them in static variables. But I am aiming to
> > > > store them in composite symbols, as (a) they are 'permanent' like
> > > > external files and (b) my sense is that it is more efficient to pull
> > > > values from a composite symbol than from an external file.
> > > >
> > > > As I run through optimizations across different historical
> periods, I
> > > > want to build a number of composite symbols that contain the 'best
> > > > values' of optimized variables for use in 'walk forward' backtests,
> > > > and then eventual live trading.
> > > >
> > > > Hopefully the above is clearer now. Please let me know if not.
> > > >
> > > >
> > > >
> > > > --- In amibroker@xxxxxxxxxxxxxxx, "Mike" sfclimbers@ wrote:
> > > > >
> > > > > You would have to be a little more clear on exactly what it is you
> > > are
> > > > > trying to accomplish. Though, writing to a file directly, or using
> > > > > static variables might be areas to explore.
> > > > >
> > > > > Mike
> > > > >
> > > > > --- In amibroker@xxxxxxxxxxxxxxx, "ozzyapeman" <zoopfree@> wrote:
> > > > > >
> > > > > > Ah. Well that would explain that. Thanks.
> > > > > >
> > > > > > Any ideas for a possible workaround?
> > > > > >
> > > > > >
> > > > > >
> > > > > > --- In amibroker@xxxxxxxxxxxxxxx, "Mike" <sfclimbers@> wrote:
> > > > > > >
> > > > > > > Ozzy,
> > > > > > >
> > > > > > > The Stats object only contains values for built in metrics as
> > > > > > > described here (scroll to bottom):
> > > > > > >
> > > > > > > http://www.amibroker.com/guide/a_custombacktest.html
> > > > > > >
> > > > > > > Mike
> > > > > > >
> > > > > > > --- In amibroker@xxxxxxxxxxxxxxx, "ozzyapeman" <zoopfree@>
> > > wrote:
> > > > > > > >
> > > > > > > > Hello, I've read Herman's excellent doc, "IntroToATC".
> > > > > > > >
> > > > > > > > I am trying to run an optimization, and then store the
> values
> > > of
> > > > > the
> > > > > > > > optimized variables in some composite symbols. I later
> want to
> > > > > pull
> > > > > > > > values of a certain range and input them automatically in
> > > > > another
> > > > > > > AFL.
> > > > > > > > However, I keep getting a syntax error that the fields
> are not
> > > > > > > > available, even though they clearly are.
> > > > > > > >
> > > > > > > > Hoping someone can point out my mistake, or give me some
> > > > > > > suggestions on
> > > > > > > > what else to try.
> > > > > > > >
> > > > > > > > Here is the code. Any ideas? :
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > //--------------------------------------------------------------
> > > > > ----
> > > > > > > --
> > > > > > > > // TRADING SYSTEM
> > > > > > > >
> > > //--------------------------------------------------------------
> > > > > ----
> > > > > > > --
> > > > > > > >
> > > > > > > > FastMALength = Optimize("FastMALength", 10, 1,
> 10,
> > > >
> > > > > > > 1);
> > > > > > > > SlowMALength = Optimize("SlowMALength", 20, 20, 50,
> > > > > > > 10);
> > > > > > > >
> > > > > > > > FastMA = MA( C, FastMALength );
> > > > > > > > SlowMA = MA( C, SlowMALength );
> > > > > > > > Buy = Cross( FastMA, SlowMA );
> > > > > > > > Sell = Cross( SlowMA, FastMA );
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > > > > > >
> > > //--------------------------------------------------------------
> > > > > ----
> > > > > > > --
> > > > > > > > // CUSTOM OPTIMIZATION PROCEDURE (Store opt vars in
> composite
> > > > > > > symbols)
> > > > > > > >
> > > //--------------------------------------------------------------
> > > > > ----
> > > > > > > --
> > > > > > > >
> > > > > > > > SetCustomBacktestProc( "" );
> > > > > > > >
> > > > > > > > if ( Status( "action" ) == actionPortfolio )
> > > > > > > > {
> > > > > > > > bo = GetBacktesterObject();
> > > > > > > >
> > > > > > > > // run default backtest procedure
> > > > > > > > bo.Backtest( 1 );
> > > > > > > >
> > > > > > > > st = bo.getperformancestats( 0 );
> > > > > > > >
> > > > > > > > // iterate through closed trades first
> > > > > > > > for ( trade = bo.GetFirstTrade(); trade; trade =
> > > > > bo.GetNextTrade
> > > > > > > () )
> > > > > > > > {
> > > > > > > > FastMALength = st.getvalue( "FastMALength" );
> > > > > > > > SlowMALength = st.getvalue( "SlowMALength" );
> > > > > > > >
> > > > > > > > AddToComposite( FastMALength, "~OptFastMA", "X",
> > > > > 1+2+8+16+64 );
> > > > > > > > AddToComposite( SlowMALength, "~OptSlowMA", "X",
> > > > > 1+2+8+16+64 );
> > > > > > > > }
> > > > > > > > bo.ListTrades();
> > > > > > > > }
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
__._,_.___
**** IMPORTANT ****
This group is for the discussion between users only.
This is *NOT* technical support channel.
*********************
TO GET TECHNICAL SUPPORT from AmiBroker please send an e-mail directly to
SUPPORT {at} amibroker.com
*********************
For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
http://www.amibroker.com/devlog/
For other support material please check also:
http://www.amibroker.com/support.html
*********************************
![]()
__,_._,___
|