[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[amibroker] Re: Building a 1-minute historical Database



PureBytes Links

Trading Reference Links

I currently do this with 500 symbols using IQFeed.

I have tried everything possible with downloading data from IB - I was never able to get it running to my satisfaction. I tried this using Amibroker as well as a variety of other utilities and software.. the bottleneck is IB - i wished I stopped trying and moved to to proper data source earlier.

Once you have IQFeed or similar, then the way to do it is to run an exploration and check the "Wait for Backfill" option. This will wait until the current backfill is complete before moving to the next symbol.

When backfilling for the first time, try to do this over a weekend. Trying to backfill such a large number of symbols during market hours will be a nightmare - AB will both backfill and subscribe the symbol for realtime streaming, so after a number of symbols, the realtime streaming on the symbols already backfilled will cause your current backfill to slow down. 

Once you have your initial set, I would suggest scheduling a save + restart + an exploration every night to keep your database updated. On 500 symbols this process takes me around 25 minutes.

hope this helps,
regards,
eToke 


--- In amibroker@xxxxxxxxxxxxxxx, "papadawg1" <papadawg1@xxx> wrote:
>
> Anyone have suggestions as to how to most efficiently build a 1-minute historical DB for ~1000 stocks or so...I've begun trying leveraging IB/TWS, but, with the throttling, and inability to skip over previously filled symbols automatically (at least as far as I can tell), seems rather difficult.  I could probably take the time to build up a 30 day DB, but not sure how to keep it current without spending an inordinate amount of time.
> 
> Any thoughts?  Anyone have suggestions on an optimal data source?
> 
> Thanks a bunch,
> Jayson
>




------------------------------------

**** IMPORTANT PLEASE READ ****
This group is for the discussion between users only.
This is *NOT* technical support channel.

TO GET TECHNICAL SUPPORT send an e-mail directly to 
SUPPORT {at} amibroker.com

TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
http://www.amibroker.com/feedback/
(submissions sent via other channels won't be considered)

For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
http://www.amibroker.com/devlog/

Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/amibroker/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/amibroker/join
    (Yahoo! ID required)

<*> To change settings via email:
    mailto:amibroker-digest@xxxxxxxxxxxxxxx 
    mailto:amibroker-fullfeatured@xxxxxxxxxxxxxxx

<*> To unsubscribe from this group, send an email to:
    amibroker-unsubscribe@xxxxxxxxxxxxxxx

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/