[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[amibroker] Re: Scan times



PureBytes Links

Trading Reference Links

Yeah it's not that TJ. Max number of streaming symbols is set to 500 and I'm actively looking at less than 50 symbols.

I have e-mailed Marcin with all relevant details.

Thanks

--- In amibroker@xxxxxxxxxxxxxxx, "Tomasz Janeczko" <groups@xxx> wrote:
>
> If scan times vary that much on your end it may mean that your scan
> is triggering backfill over and over again. This may happen if you are exceeding
> the symbol limit of your subscription. You should check File->Database Settings->Configure
> "number of streaming symbols" - this should be set to number equal to
> your subscription limit and the total number of symbols under scan
> and currently displayed in charts and in RT window should not exceed
> that limit. Otherwise constant backfill requests will slow down the operation
> because IQFeed does take time to respond to backfill request.
> 
> As I wrote, when all symbols are on the RT streaming list and backfilled already, it takes 6 seconds to run
> such scan on 124 symbols.
> 
> Best regards,
> Tomasz Janeczko
> amibroker.com
> ----- Original Message ----- 
> From: "sidhartha70" <sidhartha70@xxx>
> To: <amibroker@xxxxxxxxxxxxxxx>
> Sent: Wednesday, September 02, 2009 9:46 AM
> Subject: [amibroker] Re: Scan times
> 
> 
> > TJ,
> >
> > Sorry. I should have mentioned, I have n=1 and 'n last quotations' selected.
> >
> > TIA
> >
> > --- In amibroker@xxxxxxxxxxxxxxx, "Tomasz Janeczko" <groups@> wrote:
> >>
> >> Hello,
> >>
> >> PRECISION. That is a key word. Follow precisely what I write.
> >>
> >> I wrote something different:
> >>
> >> Buy = 0;
> >>
> >> *NOT* 1
> >>
> >> It makes huge difference because with 100000 bars, buy = 1 means
> >> OUTPUTTING 100000 lines of texts per symbol, so in your case it will be outputing
> >> 2.4 million lines of texts. Not something that can be done in few seconds.
> >>
> >> Best regards,
> >> Tomasz Janeczko
> >> amibroker.com
> >> ----- Original Message ----- 
> >> From: "sidhartha70" <sidhartha70@>
> >> To: <amibroker@xxxxxxxxxxxxxxx>
> >> Sent: Wednesday, September 02, 2009 12:37 AM
> >> Subject: [amibroker] Re: Scan times
> >>
> >>
> >> > TJ,
> >> >
> >> > Just to illustrate the 'black magic element' of all this... I just set up one line of code as you suggested,
> >> >
> >> > Buy = 1;
> >> >
> >> > I've now run a few scans across my filter watchlist using that code.
> >> >
> >> > So far I've seen variations in scan time from 22 seconds to almost 4 mins... that's using an IQ Feed DB.
> >> >
> >> > Is this kind of behavior normal...?
> >> >
> >> >
> >> > --- In amibroker@xxxxxxxxxxxxxxx, "Tomasz Janeczko" <groups@> wrote:
> >> >>
> >> >> You don't provide any formula or any details to help you,
> >> >> but you should try
> >> >>
> >> >> Buy = 0; Sell = 0;
> >> >>
> >> >> scan. It will show you "data access" only speed. It is *BASE* time
> >> >> below which you can go down because the data source is limiting you.
> >> >>
> >> >> On my eSignal intraday database that has 200000+ bars per symbol
> >> >> scanning 124 symbols with such basic formula takes 6 seconds
> >> >> (all symbols streaming and backfilled already)
> >> >>
> >> >> Any time above that base time is caused by the formula you wrote.
> >> >>
> >> >> Best regards,
> >> >> Tomasz Janeczko
> >> >> amibroker.com
> >> >> ----- Original Message ----- 
> >> >> From: "sidhartha70" <sidhartha70@>
> >> >> To: <amibroker@xxxxxxxxxxxxxxx>
> >> >> Sent: Tuesday, September 01, 2009 11:39 PM
> >> >> Subject: [amibroker] Re: Scan times
> >> >>
> >> >>
> >> >> > TJ,
> >> >> >
> >> >> > doesn't seem to help... I'm running it now with 'wait for backfill' unchecked. Same huge wait time.
> >> >> >
> >> >> > Scan's are like black magic I find... the time they take seems to bear no resemblance to the code behind them... worse than
> >> >> > that,
> >> >> > I have seen huge variations in the time taken to run exactly the same scan across the same number of bars & same symbol
> >> >> > list.
> >> >> >
> >> >> > Often they seem to jam up or have a 'mini hang'.
> >> >> >
> >> >> > I'm at a loss. Any ideas...? 14 mins can't be right. Anything more than a couple of mins can't be right surely...? Even that
> >> >> > sounds a lot.
> >> >> >
> >> >> > --- In amibroker@xxxxxxxxxxxxxxx, "Tomasz Janeczko" <groups@> wrote:
> >> >> >>
> >> >> >> Uncheck "wait for backfill".
> >> >> >>
> >> >> >> Best regards,
> >> >> >> Tomasz Janeczko
> >> >> >> amibroker.com
> >> >> >> ----- Original Message ----- 
> >> >> >> From: "sidhartha70" <sidhartha70@>
> >> >> >> To: <amibroker@xxxxxxxxxxxxxxx>
> >> >> >> Sent: Tuesday, September 01, 2009 9:54 PM
> >> >> >> Subject: [amibroker] Scan times
> >> >> >>
> >> >> >>
> >> >> >> > I'm confused.
> >> >> >> > I have a scan that I call every 5 mins (or hope to). This scan is used to set up a series of static arrays that I use
> >> >> >> > elsewhere
> >> >> >> > in
> >> >> >> > my code.
> >> >> >> >
> >> >> >> > The scan code is 30 lines long. A 'check' of the code says it takes 0.035 secs to run.
> >> >> >> >
> >> >> >> > I'm running the code over a defined filter which is a watch list of symbols. It runs across 24 symbols.
> >> >> >> >
> >> >> >> > My DB has 100,000 bars in it.
> >> >> >> >
> >> >> >> > Even with everything backfilled, I have seen this scan take 14 mins to run. That can't be right can it...??
> >> >> >> >
> >> >> >> >
> >> >> >> >
> >> >> >> >
> >> >> >> > ------------------------------------
> >> >> >> >
> >> >> >> > **** IMPORTANT PLEASE READ ****
> >> >> >> > This group is for the discussion between users only.
> >> >> >> > This is *NOT* technical support channel.
> >> >> >> >
> >> >> >> > TO GET TECHNICAL SUPPORT send an e-mail directly to
> >> >> >> > SUPPORT {at} amibroker.com
> >> >> >> >
> >> >> >> > TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
> >> >> >> > http://www.amibroker.com/feedback/
> >> >> >> > (submissions sent via other channels won't be considered)
> >> >> >> >
> >> >> >> > For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
> >> >> >> > http://www.amibroker.com/devlog/
> >> >> >> >
> >> >> >> > Yahoo! Groups Links
> >> >> >> >
> >> >> >> >
> >> >> >> >
> >> >> >>
> >> >> >
> >> >> >
> >> >> >
> >> >> >
> >> >> > ------------------------------------
> >> >> >
> >> >> > **** IMPORTANT PLEASE READ ****
> >> >> > This group is for the discussion between users only.
> >> >> > This is *NOT* technical support channel.
> >> >> >
> >> >> > TO GET TECHNICAL SUPPORT send an e-mail directly to
> >> >> > SUPPORT {at} amibroker.com
> >> >> >
> >> >> > TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
> >> >> > http://www.amibroker.com/feedback/
> >> >> > (submissions sent via other channels won't be considered)
> >> >> >
> >> >> > For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
> >> >> > http://www.amibroker.com/devlog/
> >> >> >
> >> >> > Yahoo! Groups Links
> >> >> >
> >> >> >
> >> >> >
> >> >>
> >> >
> >> >
> >> >
> >> >
> >> > ------------------------------------
> >> >
> >> > **** IMPORTANT PLEASE READ ****
> >> > This group is for the discussion between users only.
> >> > This is *NOT* technical support channel.
> >> >
> >> > TO GET TECHNICAL SUPPORT send an e-mail directly to
> >> > SUPPORT {at} amibroker.com
> >> >
> >> > TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
> >> > http://www.amibroker.com/feedback/
> >> > (submissions sent via other channels won't be considered)
> >> >
> >> > For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
> >> > http://www.amibroker.com/devlog/
> >> >
> >> > Yahoo! Groups Links
> >> >
> >> >
> >> >
> >>
> >
> >
> >
> >
> > ------------------------------------
> >
> > **** IMPORTANT PLEASE READ ****
> > This group is for the discussion between users only.
> > This is *NOT* technical support channel.
> >
> > TO GET TECHNICAL SUPPORT send an e-mail directly to
> > SUPPORT {at} amibroker.com
> >
> > TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
> > http://www.amibroker.com/feedback/
> > (submissions sent via other channels won't be considered)
> >
> > For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
> > http://www.amibroker.com/devlog/
> >
> > Yahoo! Groups Links
> >
> >
> >
>




------------------------------------

**** IMPORTANT PLEASE READ ****
This group is for the discussion between users only.
This is *NOT* technical support channel.

TO GET TECHNICAL SUPPORT send an e-mail directly to 
SUPPORT {at} amibroker.com

TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
http://www.amibroker.com/feedback/
(submissions sent via other channels won't be considered)

For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
http://www.amibroker.com/devlog/

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/amibroker/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/amibroker/join
    (Yahoo! ID required)

<*> To change settings via email:
    mailto:amibroker-digest@xxxxxxxxxxxxxxx 
    mailto:amibroker-fullfeatured@xxxxxxxxxxxxxxx

<*> To unsubscribe from this group, send an email to:
    amibroker-unsubscribe@xxxxxxxxxxxxxxx

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/