[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [amibroker] Re: JimSwindle> US STOCKS DATABASE UPDATE



PureBytes Links

Trading Reference Links

Well, I'm not sure why anyone needs to pay for stuff that's available free. 
For instance, CSI is a great vendor, but then Yahoo gets the data from CSI 
and publishes it for free.  What's really needed is the list of tickers, 
however, and perhaps that can only be done efficiently by paying for it.

For me, it's not so bad that there's a ticker that no longer exists -- I 
just check to see what the last download date was -- if it's in the past 
then I assume it's dead.

However, keeping up with new issues is more difficult.  I don't understand 
how to scrape the Yahoo site for a list of, say all of the current ETFs, or 
all of the stocks currently trading on the AMEX.  Can anyone help me with 
that?

I was using Swindle's list, but now that seems to be gone... so I need to 
hunt for a new list.

Thanks


----- Original Message ----- 
From: "dingo" <dingo@xxxxxxxxxxx>
To: <amibroker@xxxxxxxxxxxxxxx>
Sent: Tuesday, June 03, 2008 10:23 PM
Subject: RE: [amibroker] Re: JimSwindle> US STOCKS DATABASE UPDATE


>I haven't investigated any thing other than Yahoo.  If there is a weg site
> that lists the tickers, etc without having a subscription, etc. then I 
> could
> prolly scrape it.
>
> As designed the program scrapes the data and presents it to you in a grid
> organized by sector/industry or index or etf then you can select those 
> that
> you want to delete and THEN it will create the database.
>
> d
>
>> -----Original Message-----
>> From: amibroker@xxxxxxxxxxxxxxx
>> [mailto:amibroker@xxxxxxxxxxxxxxx] On Behalf Of marketmonk777
>> Sent: Tuesday, June 03, 2008 8:35 PM
>> To: amibroker@xxxxxxxxxxxxxxx
>> Subject: [amibroker] Re: JimSwindle> US STOCKS DATABASE UPDATE
>>
>> I would be interested in this program.  But all I am looking for is a
>> program that creates a list of symbols.  What would be nice is for it
>> to "compare" a current download to a previous download and have a
>> report generated showing what was added and what is missing.
>>
>> That way I can decide which stocks to add to my own database.
>>
>> The benefit to me is that I don't have to strip out symbols from the
>> pink sheets or OTC BB.
>>
>> Amiquote does a great job of downloading the data and don't see a need
>> to replace that functionality.
>>
>> As for the price .. that would depend on the functionality that you
>> decide to put into it.  Will it work with just Yahoo?
>>
>> Regards,
>> MM
>>
>> --- In amibroker@xxxxxxxxxxxxxxx, "dingo" <dingo@xxx> wrote:
>> >
>> > There is not a separate list of added / deleted stocks - Yahoo just
>> updates
>> > their site on the fly. You would need to build a new list
>> and compare it
>> > with those in the database. There is a trail of Yahoo pages that
>> contains
>> > what they consider to be the stocks avail in the US - grouped by
>> sector /
>> > industry.  These pages have to be scraped to get the tickers and
>> names. Then
>> > a problem arises when you go to down load quotes for the entire list
>> that
>> > you've built by scraping - Yahoo doesn't have quotes for
>> all of them and
>> > some have even had their tickers changed but the pages haven't been
>> updated
>> > yet.  Plus, you also get pink sheet stocks and other "stuff".  The
>> indexes,
>> > etfs, mutual funds, etc are all on their own pages and
>> would have to be
>> > scraped also.
>> >
>> > I've done some of this in a program I wrote several years
>> ago - it even
>> > updates the quotes and can be scheduled via the scheduler.  It will
>> retireve
>> > historical, current and fundamental data.  What it doesn't do at
>> present is
>> > detect those stocks that have no quotes or that have ceased trading
>> - those
>> > that give an error msg when you try to use Amiquote.  It
>> also does NOT
>> > update the database - it just builds them and updates the quotes. I
>> stopped
>> > working on it because I thought TJ was going to address this and
>> decided not
>> > put any more of my time into it.
>> >
>> > I can be talked into finishing it but I won't do it for free - I
>> done quite
>> > a few free programs for AB and won't do that any more.
>> >
>> > Soooo - what's a price that people are willing to pay and and how
>> many would
>> > be interested.  If theres not that much interest then I
>> won't bother.
>> >
>> > d
>> >
>> >
>> >   _____
>> >
>> > From: amibroker@xxxxxxxxxxxxxxx [mailto:amibroker@xxxxxxxxxxxxxxx]
>> On Behalf
>> > Of cstrader
>> > Sent: Tuesday, June 03, 2008 6:20 PM
>> > To: amibroker@xxxxxxxxxxxxxxx
>> > Subject: Re: [amibroker] JimSwindle> US STOCKS DATABASE UPDATE
>> >
>> >
>> > Hi Ronald,
>> >
>> > You say:
>> >
>> > ... DOWNLOAD ALL OF THE SYMBOLS THAT "YAHOO" has ADDED  in
>> their "YAHOO"
>> > database of STOCK SYMBOLS AND PRICES, VOL ,etc.
>> >
>> > DO YOU KNOW WHERE THAT "ADDED" LIST IS LOCATED?
>> >
>> > If YAHOO discontinues carrying  a symbol, then their NEW
>> CURRENT list of
>> > symbols will...NOT...
>> >
>> > DO YOU KNOW WHERE THAT "NEW CURRENT" LIST IS LOCATED?  AND WHAT IS
>> THE "NEW
>> > CURRENT" LIST.
>> >
>> > I'M CURIOUS IF IT'S POSSIBLE TO DOWNLOAD THE ENTIRE LIST OF
>> YAHOO STOCKS
>> > SOMEHOW.
>> >
>> > Thanks
>> >
>> >
>> > ----- Original Message ----- 
>> > From: Ronald Davis <mailto:xokie7@...>
>> > To: amibroker@xxxxxxxxxxxxxxx
>> > Sent: Tuesday, June 03, 2008 5:27 PM
>> > Subject: Re: [amibroker] JimSwindle> US STOCKS DATABASE UPDATE
>> >
>> > Cs, he HAS been doing it for free.
>> >
>> > AB does NOT KNOW which symbols are current.
>> >
>> > That is why there exists a need DOWNLOAD ALL OF THE SYMBOLS THAT
>> "YAHOO" has
>> > ADDED  in their "YAHOO" database of STOCK SYMBOLS AND PRICES, VOL
>> ,etc.
>> >
>> > If YAHOO discontinues carrying  a symbol, then their NEW
>> CURRENT list of
>> > symbols will , NOT have it anymore, and it will have been purged
>> from your
>> > AB database of SYMBOLS in the AB US STOCKS FOLDER.   Ron D
>> >
>> > ----- Original Message ----- 
>> > From: cstrader <mailto:cstrader232@...>
>> > To: amibroker@xxxxxxxxxxxxxxx
>> > Sent: Tuesday, June 03, 2008 4:03 PM
>> > Subject: Re: [amibroker] JimSwindle> US STOCKS DATABASE UPDATE
>> >
>> > Aha, I thought Jim was doing this for free.  But in any case, how
>> does AB
>> > determine which stocks are current and should be on the
>> list?  Yahoo has
>> > almost 40,000 tickers; who determines which ones go into the US
>> STOCK SYMBOL
>> > list?
>> >
>> >
>> > Thanks
>> >
>> >
>> > ----- Original Message ----- 
>> > From: Ronald  <mailto:xokie7@...> Davis
>> > To: amibroker@xxxxxxxxxxxxxxx
>> > Sent: Tuesday, June 03, 2008 4:17 PM
>> > Subject: Re: [amibroker] JimSwindle> US STOCKS DATABASE UPDATE
>> >
>> > This origional post was an inquiry asking when Jim Swindle
>> would place a
>> > LATER than >JAN/4/2008 UPDATED LIST OF US STOCK SYMBOLS on
>> his UPDATE
>> > website.
>> >
>> > Jim was paid to create this updating UPDATING software, so
>> he is not at
>> > liberty to simply give it away to Amibroker users.
>> >
>> > Yes, I would love to help JIM, but I can't think of
>> anything I can do to
>> > assist writing code FOR a NEW version of this updating software.
>> > I do recall that Dingo and Jim discussed the possibility of a Joint
>> effort
>> > once, BUT I DON'T THINK IT WENT ANYWHERE.
>> >
>> >
>> > HERE IS MORE INFORMATION>>Jim Swindle's  US STOCKS DATABASE UPDATE
>> SITE  is
>> > simply an updated  list of the
>> > most recent SYMBOLS  in the US STOCKS FOLDER within Amibroker.
>> > When you run a download from this site, it installs the MORE RECENT
>> list of
>> > the symbols over the OLDER  list of symbols.
>> > This process of UPDATING  the symbols must be followed by a
>> HISTORICAL
>> > download of all of the TICKER data for as far back as you want to
>> have in
>> > your database.
>> >
>> >
>> ==============================================================
>> ==============
>> > ===========
>> >
>> >
>> > ----- Original Message ----- 
>> > From: cstrader <mailto:cstrader232@...>
>> > To: amibroker@xxxxxxxxxxxxxxx
>> > Sent: Tuesday, June 03, 2008 1:46 PM
>> > Subject: Re: [amibroker] JimSwindle> US STOCKS DATABASE UPDATE
>> >
>> > Perhaps we should try to help Jim out a bit.  What features would we
>> want to
>> > see in such a stocks database?
>> >
>> > Thanks
>> >
>> >
>> >
>> > ----- Original Message ----- 
>> > From: Ronald  <mailto:xokie7@...> Davis
>> > To: amibroker@xxxxxxxxxxxxxxx
>> > Sent: Tuesday, June 03, 2008 9:21 AM
>> > Subject: [amibroker] JimSwindle> US STOCKS DATABASE UPDATE
>> >
>> > Has anyone heard from Jim regarding when a later update will be
>> available?
>> >
>> > This link to Jim Swindle's US STOCKS DATABASE  site shows that it
>> was last
>> > udated on Jan 4, 2008.
>> >
>> > I also recall that Jim was planning to create a method so that each
>> of us
>> > could run a LATEST TICKER symbol update an any time.
>> >
>> > We all are grateful  to Jim for having done this.   Ron D
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> <http://www.icc-az.com/icc-az/default.html?http%3A//www.icc-az
>> .com/icc-az/>
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > No virus found in this incoming message.
>> > Checked by AVG.
>> > Version: 8.0.100 / Virus Database: 269.24.6/1480 - Release Date:
>> 6/3/2008
>> > 7:00 AM
>> >
>>
>>
>>
>> ------------------------------------
>>
>> Please note that this group is for discussion between users only.
>>
>> To get support from AmiBroker please send an e-mail directly to
>> SUPPORT {at} amibroker.com
>>
>> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
>> http://www.amibroker.com/devlog/
>>
>> For other support material please check also:
>> http://www.amibroker.com/support.html
>> Yahoo! Groups Links
>>
>>
>>
>> No virus found in this incoming message.
>> Checked by AVG.
>> Version: 8.0.100 / Virus Database: 269.24.6/1480 - Release
>> Date: 6/3/2008 7:00 AM
>>
>
>
> ------------------------------------
>
> Please note that this group is for discussion between users only.
>
> To get support from AmiBroker please send an e-mail directly to
> SUPPORT {at} amibroker.com
>
> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
> http://www.amibroker.com/devlog/
>
> For other support material please check also:
> http://www.amibroker.com/support.html
> Yahoo! Groups Links
>
>
>


------------------------------------

Please note that this group is for discussion between users only.

To get support from AmiBroker please send an e-mail directly to 
SUPPORT {at} amibroker.com

For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
http://www.amibroker.com/devlog/

For other support material please check also:
http://www.amibroker.com/support.html
Yahoo! Groups Links

<*> To visit your group on the web, go to:
    http://groups.yahoo.com/group/amibroker/

<*> Your email settings:
    Individual Email | Traditional

<*> To change settings online go to:
    http://groups.yahoo.com/group/amibroker/join
    (Yahoo! ID required)

<*> To change settings via email:
    mailto:amibroker-digest@xxxxxxxxxxxxxxx 
    mailto:amibroker-fullfeatured@xxxxxxxxxxxxxxx

<*> To unsubscribe from this group, send an email to:
    amibroker-unsubscribe@xxxxxxxxxxxxxxx

<*> Your use of Yahoo! Groups is subject to:
    http://docs.yahoo.com/info/terms/