[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [amibroker] Speed the database!?



PureBytes Links

Trading Reference Links

Hi Tomasz,

I am using data that has already been downloaded with QCollector.   Hence, I am running on a local database and what takes like 3-4 seconds is scrolling through the 1-minute bars.  Let's say it is Day 1 at 11:00  and I want to scroll back to Day 0, I use my mouse wheel but for 3-4 seconds the images does not move at all, then I hear my computer loading, then I see the bars before.  Is there a way to make that faster?

Thanks,

Louis

2008/7/15 Tomasz Janeczko <groups@xxxxxxxxxxxxx>:

Hello,
 
No, it does NOT take 3-4 seconds to load each ticker. Loading (i.e. switching between symbols) is INSTANT.
 
It takes 3-4 to BACKFILL. That's huge difference.
 
Are you aware that you are on 256kbps connection. That means that your fully saturated connection is able
to deliver about 25KB of data per second.  Now do you have any idea how much data is one day
of 1-minute data?
 
As far as I remember you are using IQFeed. It delivers data in ASCII format.
 
Let's say single quote line is 100 bytes.  Compressed it is 50. Now there are 60 lines per minute and
480 lines per 8 hours. That's 24KB PER DAY PER SYMBOL of 1-minute data. That means
that it takes 1-second FULLY SATURATED your internet connection to deliver 1-day worth of 1-minute data for one symbol.
That's physical limit of your internet connection.
 
Yes there is a way to get it faster:
a) invest in better internet connection
b) subscribe to data source that allows those 500 symbols to be streaming
c) run scan with wait for backfill PRIOR to market open. Once you initialy scan all symbol
UNCHECK "wait for backfill" and scans will fun blazing fast.

Best regards,
Tomasz Janeczko
amibroker.com
----- Original Message -----
Sent: Monday, July 14, 2008 11:02 PM
Subject: [amibroker] Speed the database!?

Hi,

I have my 1-minute database setted with all my tickers and everything, but damn it it is so slow!  It takes like 3-4 seconds to load each ticker...  Is there a way to make it run faster, considering I don't need all the data when exploring?

Thanks,

Louis

__._,_.___

Please note that this group is for discussion between users only.

To get support from AmiBroker please send an e-mail directly to
SUPPORT {at} amibroker.com

For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
http://www.amibroker.com/devlog/

For other support material please check also:
http://www.amibroker.com/support.html




Your email settings: Individual Email|Traditional
Change settings via the Web (Yahoo! ID required)
Change settings via email: Switch delivery to Daily Digest | Switch to Fully Featured
Visit Your Group | Yahoo! Groups Terms of Use | Unsubscribe

__,_._,___