[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re[2]: [amibroker] Re: Speeding up code ???



PureBytes Links

Trading Reference Links

Title: Re[2]: [amibroker] Re: Speeding up code ???


I forgot to mention that you can also use the AB High-Precision timer to get finer execution control than the timed refresh can provide.


While this must be done carefully as you can get stuck in a loop, you can run loops to perform certain tasks at very high speed, for example polling a single price waiting for a change. Then when the criteria is met you break out of the loop and do whatever you need to do without any delay (instant response). The would/might break the "wait-for-quote" refresh limitation under certain conditions. Testing would be required to see if this works in your setup. I tried this long ago but i don't remember how it worked out. The response time gained might be insignificant compared to other delays, like those imposed by the Internet. 


herman



Friday, July 3, 2009, 7:34:56 AM, you wrote:


>




See capture below...


It may be possible (i haven't tried it) by partitioning code and running them in their own panes with their own unique SetbarsRequired(). 


In my naive opinion, a preferred method would be if AB had a SetBarsRequired() that could be called repeatedly, in effect this would allocated code to different panes without displaying separate panes. For example each Sections_() could have its own SetbarsRequired(); Eventually I think we will see this feature implemented like we saw _Section_()s, TimeFrames(), etc. that can be called repeatedly and control the program environment. 


It would be nice to be able to create/use a virtual pane to isolated and control the environment for afl. 


For personal reasons I like to keep things as easy as possible ;-) hence I prefer to stick to 32bit XP so that I don't run into problems with drivers and other programs i use. The days that I enjoyed installing an OS and learn new features have long gone. At today's level of technology it should be possible to use a computer, like many other sophisticated tools, by just using the GUI. Without know 'how' it works. 


I have found that spending time on optimizing the program design and code is a logical first step that often gives greater benefits than changing hardware. An exception is when you need more than 4GBytes of memory. But proper written Indicator code may not need more than that. 


It is essential to know how AmiBroker processes arrays and how to control bars required. Most of the time the only way to figure this out is to write test programs. 


wrt prioritizing code for speed:


A) Normally code executes on each new quote received. This is the highest order of execution and should be used only for critical stuff, for example polling the last Price to see if it meets you setup requirements.


B) Next you can use the RequestTimedRefresh() to execute code on second (or greater) bounderies. You execute code only when Status("redrawaction") is true.


C) You can execute code dynamically, for example only when the last price (or MA etc) has changed sufficiently to warrant a new execution of a lengthy process.


D) Many function in AT/RT trading only deal with last values. You can often collect (Static variables) a limited number of last values and calculate your own functions. This works for example for MA() and other simple formula that span just few periods. It is faster to calc a Ma(C,5) using numbers than using arrays that use thousands of bars.


E) Results that do not change in the timeframe used should be pre-calculated. They can stored in Static variables, Composites, or files.


F) I have heard people use array-cloning to reduce overhead - i have never used that.


You can try poll RT prices for a watchlist using a simple loop:



Below is a capture of RT afl that polls 498 tickers in Real-Time, calculates values, sorts (OSAKA plugin) them by rank, displays the top n tickers in a bar chart, displays a Button panel for ordering and to display order status. Clicking on a Buy cell places the order, changes its color, and fills it with an order status msg. This idea can be used to trade individual or custom (RT!) indices. The market is now closed so this will execute slower if RT data was coming in, however the 65 Millisecond execution time (IQFeed) shows that a lot can be done with proper programming :-) btw, note that this works because of the minimal use of arrays. 


I am not a professional programmer, I only use afl and simply tinker until it works. My conclusion: afl is VERY FAST!


herman









Thursday, July 2, 2009, 9:08:04 PM, you wrote:


> Hi Herman,


> I was starting to probe the subject of 'optimal RT performance' in Dennis's

> thread. Trading systems has to be at least as important as desiging them and all trading is RT!


> It is hard for me to stay on the page because a matrix starts to appear, in

> my concsiousness, and I can see the interconnecting threads going in all directions, but I'll try.


> I don't think we have squeezed all of the juice out of the orange by a long

> way but your comments seem to mark out the playing field.


> So far I am just starting to play around with the following ideas:


> - review the OS I am using (any real benefits in using Linux etc)

> - the machines I am using (we have discussed this quite a bit ... the 64 bit story continues?  .. RAM and cache)

> - a dedicated machine (any point in going further than Mike indicates re

> using task manager to prioritize ..... MS comes with a lot of junk I don't use

> ... maybe I will talk to my techie about custom installs for my trading machines ... strip the OS right down

> - Paul's idea of farming out some dirty work to C++ plugins and managing memory allocation there

> - AB develops a brain and slaps me when I am doing less than optimal things with my machine or code

> - managing blocks of AFL to run at different times etc ..... Siddharthas code

> example in Dennis's topic points to one simple way I think.

> - twisting the CPU' arm (in more sophisticated ways than using Windows  Task Manager

> - more to come?


> I don't expect you to answer these questions ... I am just reviewing my

> understanding, of the potential, or the scope, to date.




> Over to your comments:


> Very interesting.


> Have you published anything on the subjects you listed? (if you have covered this at the UKB I will just go there).


>> Anyway, we all have to figure out what works for each of us.


> It sure helps if we pool our philosophies, knowledge and experience first though.


>> you can partition and prioritize RT code, and execute sections of >code on a schedule that doesn't conflict with placing trades. This >allows you to run code code in RT that would lock up any other way. 


> Briefly ... in laypersons terms .. how are you doing that?


>>Using getrtdataforeign() and simple formulas I can scan, in RT, 100 >(easy) to 500 (pushing it) tickers in real time, and display the top >candidates using a gfx chart.


> Very impressive .... so far I have been too scared to even try RT scanning,

> sorting etc .... I find it scary enough in EOD.


> How are you doing that?


>>You may also be able to partition code based on BarsRequired and run >formulas in a separate panes, each with the minimum number of bars >required. Use Static Arrays to share results.


> Any further hints on that?


>>Also, many real time trading routines only need a few prices you can >keep track of yourself - separate these from the arrays processing >pane.


> You seem to be implying that we can use panes to 'partition' code and control

> it's execution. What is the basic execution model that AB uses to manage panes, in relation to each other?




> ------------------------------------


> **** IMPORTANT PLEASE READ ****

> This group is for the discussion between users only.

> This is *NOT* technical support channel.


> TO GET TECHNICAL SUPPORT send an e-mail directly to 

> SUPPORT {at} amibroker.com


> TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at

> http://www.amibroker.com/feedback/

> (submissions sent via other channels won't be considered)


> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:

> http://www.amibroker.com/devlog/


> Yahoo! Groups Links


> <*> To visit your group on the web, go to:

>     http://groups.yahoo.com/group/amibroker/


> <*> Your email settings:

>     Individual Email | Traditional


> <*> To change settings online go to:

>     http://groups.yahoo.com/group/amibroker/join

>     (Yahoo! ID required)


> <*> To change settings via email:

>     mailto:amibroker-digest@xxxxxxxxxxxxxxx 

>     mailto:amibroker-fullfeatured@xxxxxxxxxxxxxxx


> <*> To unsubscribe from this group, send an email to:

>     amibroker-unsubscribe@xxxxxxxxxxxxxxx


> <*> Your use of Yahoo! Groups is subject to:

>     http://docs.yahoo.com/info/terms/








__._,_.___


**** IMPORTANT PLEASE READ ****
This group is for the discussion between users only.
This is *NOT* technical support channel.

TO GET TECHNICAL SUPPORT send an e-mail directly to
SUPPORT {at} amibroker.com

TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
http://www.amibroker.com/feedback/
(submissions sent via other channels won't be considered)

For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
http://www.amibroker.com/devlog/





Your email settings: Individual Email|Traditional
Change settings via the Web (Yahoo! ID required)
Change settings via email: Switch delivery to Daily Digest | Switch to Fully Featured
Visit Your Group | Yahoo! Groups Terms of Use | Unsubscribe

__,_._,___