|
PureBytes Links
Trading Reference Links
|
Tomasz,
Thanks for your input. I've got another question. Assuming preference of priority to Amibroker above all other programs, a decent amount of available disk space to store stock information, say, 5TB, but you still want Amibroker to be able to load up quickly, would you still keep this "Max MegaBytes" setting to half of RAM? How does "Number of bars to load" factor into this?
What I'm getting at is that suppose I collect some data in very small intervals, more than 1GB per symbol per month, but I would like this data available for pure archival purposes, since backtesting is performed over small intervals. Should I backup the entire database every month or so to some other location and reset the database, or is there some combination of values in these settings that would allow accumulation of a large library of data while keeping Amibroker fairly quick to load and perform intraday tasks?
--- In amibroker@xxxxxxxxxxxxxxx, "Tomasz Janeczko" <groups@xxx> wrote:
>
> Hello,
>
> Data tab cache settings recommendations:
> "Max MegaBytes" should be set to half of physical RAM installed
> (by the way it is set so automatically by AmiBroker), but not more than
> 2000 MB (2GB).
>
> "Max. symbols" - the best is when it is set to number higher
> than number of symbols under test (or in the database),
> then subsequent optimizations can work entirely from RAM.
>
> The cost to other programs may be that if they need lots of RAM,
> swapping may be excessive when switching tasks.
>
> Best regards,
> Tomasz Janeczko
> amibroker.com
> ----- Original Message -----
> From: "Mike" <sfclimbers@xxx>
> To: <amibroker@xxxxxxxxxxxxxxx>
> Sent: Tuesday, March 31, 2009 8:29 PM
> Subject: [amibroker] Re: OT: Computer recommendation for AB optimizing
>
>
> > Tomasz,
> >
> > Can you offer some guidance for what values to use in the "Data" tab cache settings?
> >
> > First, what would optimal values be for AmiBroker usage, ignoring all other programs.
> >
> > Second, taking into consideration other programs, what is the cost to other programs as a result of optimal AmiBroker values.
> >
> > Thanks,
> >
> > Mike
> >
> > --- In amibroker@xxxxxxxxxxxxxxx, "Tomasz Janeczko" <groups@> wrote:
> >>
> >> Hello,
> >>
> >> Windows memory manager is unfortunatelly not the best on the planet.
> >> The problem is not the amout of memory, but the fragmentation that occurs
> >> over time.
> >> Thats one of the reasons why they rewrote it in Windows 7.
> >>
> >> What you may do now on Vista is disabling Superfetch Windows feature as it consumes several
> >> gigabytes of your RAM.
> >>
> >> Also you may go to Tools->Preferences, "Data" tab and adjust caching settings here.
> >>
> >> Because of memory manager problems, AmiBroker already uses custom allocators
> >> for some sensitive parts because without that program would run out of contiguous memory much sooner
> >> because of fragmentation (and it did before these allocators were implemented) .
> >> The use of custom allocators will probably be extended in future.
> >>
> >> Best regards,
> >> Tomasz Janeczko
> >> amibroker.com
> >> ----- Original Message -----
> >> From: "ozzyapeman" <zoopfree@>
> >> To: <amibroker@xxxxxxxxxxxxxxx>
> >> Sent: Tuesday, March 31, 2009 1:59 AM
> >> Subject: [amibroker] Re: OT: Computer recommendation for AB optimizing
> >>
> >>
> >> > Dang! A bit of a false alarm in being able to run 8 instances in parallel. I had assumed (always a mistake) that the runs went
> >> > smoothly. But when I checked my PC this morning, found out that the runs did not actually complete. The PC must have crashed
> >> > and
> >> > rebooted somewhere in between.
> >> >
> >> > So I restarted, this time, using only 4 instances, and sat in front of the screen for a few minutes. Indeed, the system crashed
> >> > with a "Memory management error"!
> >> >
> >> > Damn! With 12GB of ram on Vista64 with an i7 processor (seen as 8 processors by the OS), shouldn't I be able to run 4 measly
> >> > instances of AB, each doing an optimization over 2-years worth of 1-minute data? The total size of my symbol database is only
> >> > 156mb.
> >> >
> >> > It's a new PC with a fresh install, and only Avast anti virus running at startup. The only other programs installed are AB,
> >> > Firefox, Office 2003 and Thunderbird. And when I run AB, all other programs are closed.
> >> >
> >> > Is there some memory management utility I can run that can better allocate memory?
> >> >
> >> > Or is Vista64 really no better than plain old WinXP32, as far as being able to run more instances of AB on a single machine? I
> >> > thought that one of the main advantages of Vista64 over XP32 was precisely the ability to make more RAM available for multiple
> >> > instances of a program.
> >> >
> >> >
> >> >
> >> > --- In amibroker@xxxxxxxxxxxxxxx, "ozzyapeman" <zoopfree@> wrote:
> >> >>
> >> >> I was comparing Vista64 to XP32 (which I was using), not XP64.
> >> >>
> >> >> I imagine XP64 would probably allow one to run as many instances of AB as Vista64. But from what I could gather, XP64 seemed
> >> >> less
> >> >> reliable/stable/supported than Vista64, so I went with the latter.
> >> >>
> >> >> Been using Vista64 on an overclocked i7 PC, with 12GB ddr3 ram now for about a week. Certainly a big difference over my XP32
> >> >> install. Yesterday I ran 8 large walk-forward tests in parallel (1-min databases, several years), no problem. Didn't even come
> >> >> close to maxing out the system. The XP32 install would tend to hang/crash if I tried 3 such parallel runs.
> >> >>
> >> >> Will play around with multiple instances over the next few weeks to see just how far I can push things.
> >> >>
> >> >> And once I turned off that annoying UAC thing, haven't noticed any disadvantages yet with Vista. Maybe its bad reputation was
> >> >> only warranted in the first year it was out - with respect to driver issues and other problems. All that stuff seems to have
> >> >> been
> >> >> cleared up in the latest service packs.
> >> >>
> >> >>
> >> >>
> >> >> --- In amibroker@xxxxxxxxxxxxxxx, Keith McCombs <kmccombs@> wrote:
> >> >> >
> >> >> > Ozzy --
> >> >> > What makes you think that, given the same hardware, Vista64 allows you
> >> >> > to run more instances of AB than XP64?
> >> >> >
> >> >> > TJ --
> >> >> > Thanks for your comments on the subject. Admittedly, I didn't
> >> >> > understand how he was doing the testing.
> >> >> >
> >> >> > All --
> >> >> > Once again I would like to suggest:
> >> >> > "How about writing some benchmarks in afl? I assume the code wouldn't
> >> >> > have to be very complex, nor would it have to be for any sort of
> >> >> > 'winning' system. Just something that everyone could run and we could
> >> >> > get some comparative speed results." We might also need to make a
> >> >> > static artificial data base so that everyone was running the same test.
> >> >> >
> >> >> > That would help many of us when it comes time to buy a new, or update an
> >> >> > older, computer.
> >> >> > -- Keith
> >> >> >
> >> >> > ozzyapeman wrote:
> >> >> > >
> >> >> > > Thanks for the clarification.
> >> >> > >
> >> >> > > My understanding then, based on what I can gather from the net, is
> >> >> > > that Windows Vista 64-bit will give me the sole advantage of allowing
> >> >> > > me to run many more instances of AmiBroker, especially with the i7
> >> >> > > processor and 12 GB of RAM, vs on WinXP.
> >> >> > >
> >> >> > > In that way, I can run more large optimizations simultaneously,
> >> >> > > without running out of memory, thus saving a lot of time overall.
> >> >> > >
> >> >> > > I had come across one article that tested as much, with other 32-bit
> >> >> > > apps running on XP32 vs Vista64, and the difference in multitasking
> >> >> > > ability was huge.
> >> >> > >
> >> >> > > --- In amibroker@xxxxxxxxxxxxxxx <mailto:amibroker%40yahoogroups.com>,
> >> >> > > "Tomasz Janeczko" <groups@> wrote:
> >> >> > > >
> >> >> > > > Those Windows Vista tests were made using Microsoft SQL server.
> >> >> > > >
> >> >> > > > AmiBroker does NOT use Microsoft SQL server or any other 3rd party DB.
> >> >> > > > It uses own original low-level database that is highly specialized
> >> >> > > > for quote processing is pretty independent from operating system.
> >> >> > > > It works equally well on every Windows version
> >> >> > > > (starting from Win95 and ending at Windows 7).
> >> >> > > >
> >> >> > > > Best regards,
> >> >> > > > Tomasz Janeczko
> >> >> > > > amibroker.com
> >> >> > > > ----- Original Message -----
> >> >> > > > From: "ozzyapeman" <zoopfree@>
> >> >> > > > To: <amibroker@xxxxxxxxxxxxxxx <mailto:amibroker%40yahoogroups.com>>
> >> >> > > > Sent: Tuesday, March 17, 2009 7:17 AM
> >> >> > > > Subject: [amibroker] Re: OT: Computer recommendation for AB optimizing
> >> >> > > >
> >> >> > > >
> >> >> > > > > Whoa. Just read that article. Seems that WinXP 64 makes better
> >> >> > > sense by far to drive my new Intel i7 PC. The speed difference is
> >> >> > > > > quite significant. I might have just wasted money shelling out on
> >> >> > > a Vista 64-bit installation disk.
> >> >> > > > >
> >> >> > > > > Is Amibroker 32-bit pretty stable on WinXP 64? I only have
> >> >> > > experience running it on WinXP 32.
> >> >> > > > >
> >> >> > > > > If I only plan on running AmiBroker 5.24, TWS 892, and other basic
> >> >> > > 32-bit trading tools on the PC (and maybe Firefox and Outlook),
> >> >> > > > > would WinXP 64 be the way to go, or are there hidden disadvantages
> >> >> > > in going with that OS?
> >> >> > > > >
> >> >> > > > > I am aiming for the fastest backtesting platform possible.
> >> >> > > > >
> >> >> > > > >
> >> >> > > > > --- In amibroker@xxxxxxxxxxxxxxx
> >> >> > > <mailto:amibroker%40yahoogroups.com>, Keith McCombs <kmccombs@> wrote:
> >> >> > > > >>
> >> >> > > > >> Dingo --
> >> >> > > > >> Please read
> >> >> > > > >>
> >> >> > > http://www.infoworld.com/article/09/01/22/03TC-windows-multicore_3.html
> >> >> > > <http://www.infoworld.com/article/09/01/22/03TC-windows-multicore_3.html>
> >> >> > > > >> for some comparisons between Vista64 and XP64.
> >> >> > > > >> -- Keith
> >> >> > > > >>
> >> >> > > > >> dingo wrote:
> >> >> > > > >> > 50% longer for AB to run - hardly believable.
> >> >> > > > >> >
> >> >> > > > >> > d
> >> >> > > > >> >
> >> >> > > > >> > On Thu, Mar 12, 2009 at 3:51 PM, Keith McCombs <kmccombs@
> >> >> > > > >> > <mailto:kmccombs@>> wrote:
> >> >> > > > >> >
> >> >> > > > >> > A few personal thoughts:
> >> >> > > > >> > 1. The 2.93GHz costs $470 more than 2.66. I doubt that very many
> >> >> > > > >> > of us can tell the difference without a stopwatch.
> >> >> > > > >> >
> >> >> > > > >> > 2. I don't know about running AB, but in many published speed
> >> >> > > > >> > tests, Vista64 takes about 50% longer than XP64.
> >> >> > > > >> >
> >> >> > > > >> > -- Keith
> >> >> > > > >> >
> >> >> > > > >> >
> >> >> > > > >> > ozzyapeman wrote:
> >> >> > > > >> >>
> >> >> > > > >> >> Thanks. I was looking into i7 based-PCs. But aren't all i7's
> >> >> > > > >> >> quad-cores to begin with? And apparently the OS sees an i7 as
> >> >> > > > >> >> 8-core due to the way it's designed.
> >> >> > > > >> >>
> >> >> > > > >> >> Dell seems to have a good deal on i7 XPS desktops at 2.93 Ghz
> >> >> > > > >> >>
> >> >> > > > >> >> --- In amibroker@xxxxxxxxxxxxxxx
> >> >> > > <mailto:amibroker%40yahoogroups.com>
> >> >> > > > >> >> <mailto:amibroker%40yahoogroups.com>, dingo <waledingo@> wrote:
> >> >> > > > >> >> >
> >> >> > > > >> >> > Intel dual core i7 with fast clock - AB only uses 1 core. 3gig
> >> >> > > > >> >> mem. Intel
> >> >> > > > >> >> > SLC flash (if you've got the money otherwise WD Raptor). Medium
> >> >> > > > >> >> video card.
> >> >> > > > >> >> >
> >> >> > > > >> >> >
> >> >> > > > >> >> > d
> >> >> > > > >> >> >
> >> >> > > > >> >> > On Wed, Mar 11, 2009 at 12:57 AM, ozzyapeman <zoopfree@> wrote:
> >> >> > > > >> >> >
> >> >> > > > >> >> > > I should add that I need to run exhaustive optimizations, as
> >> >> > > > >> >> opposed to
> >> >> > > > >> >> > > CMAE or using Fred's IO, as my variables are discontinuous -
> >> >> > > > >> >> not traditional
> >> >> > > > >> >> > > indicator-type variables.
> >> >> > > > >> >> > >
> >> >> > > > >> >> > > In my parallel dream life, I run AB Ultra Professional 7.0 on
> >> >> > > > >> >> 8 state of
> >> >> > > > >> >> > > the art graphics cards, with thousands of processors, 500,000
> >> >> > > > >> >> times faster
> >> >> > > > >> >> > > than good old AB 5.24.
> >> >> > > > >> >> > >
> >> >> > > > >> >> > > But I digress. ;-)
> >> >> > > > >> >> > >
> >> >> > > > >> >> > > In the real world, what is the best I can do?
> >> >> > > > >> >> > >
> >> >> > > > >> >> > >
> >> >> > > > >> >> > > --- In amibroker@xxxxxxxxxxxxxxx
> >> >> > > <mailto:amibroker%40yahoogroups.com>
> >> >> > > > >> >> <mailto:amibroker%40yahoogroups.com>, "ozzyapeman" <zoopfree@>
> >> >> > > wrote:
> >> >> > > > >> >> > > >
> >> >> > > > >> >> > > > Now that I am just about trading full time, my main PC has
> >> >> > > > >> >> become a
> >> >> > > > >> >> > > dedicated trading computer. That only leaves me with a clunky
> >> >> > > > >> >> second PC
> >> >> > > > >> >> > > (6-years old) for doing offline optimizing. And it's waaay
> >> >> > > > >> >> too slow.
> >> >> > > > >> >> > > >
> >> >> > > > >> >> > > > So I am in the market for a new PC, and want to get
> >> >> > > > >> >> something powerful,
> >> >> > > > >> >> > > but don't want to overpay for stuff that won't be used. For
> >> >> > > > >> >> example, 8GB of
> >> >> > > > >> >> > > RAM sounds great, but if WinXP only uses 4GB (or 3?) then I
> >> >> > > > >> >> imagine the
> >> >> > > > >> >> > > other 4 GB just goes to waste?
> >> >> > > > >> >> > > >
> >> >> > > > >> >> > > > If I plan to use this PC mainly for offline optimizing and
> >> >> > > > >> >> backtesting,
> >> >> > > > >> >> > > what are the recommended specs? I want as much speed as I can
> >> >> > > > >> >> possibly get.
> >> >> > > > >> >> > > My optimizations tend to be humongous, taking days on a quad
> >> >> > > > >> >> core.
> >> >> > > > >> >> > > >
> >> >> > > > >> >> > > > Any hardware gurus please feel free to chime in:
> >> >> > > > >> >> > > >
> >> >> > > > >> >> > > > - RAM?
> >> >> > > > >> >> > > > - Quad-core vs Eight-core?
> >> >> > > > >> >> > > > - OS?
> >> >> > > > >> >> > > > - HD type (flash vs mechanical)?
> >> >> > > > >> >> > > > - any other hardware/software suggestions for increasing
> >> >> > > speed?
> >> >> > > > >> >> > > >
> >> >> > > > >> >> > > > Thanks!
> >> >> > > > >> >> > > >
> >> >> > > > >> >> > >
> >> >> > > > >> >> > >
> >> >> > > > >> >> > >
> >> >> > > > >> >> > >
> >> >> > > > >> >> > > ------------------------------------
> >> >> > > > >> >> > >
> >> >> > > > >> >> > > **** IMPORTANT PLEASE READ ****
> >> >> > > > >> >> > > This group is for the discussion between users only.
> >> >> > > > >> >> > > This is *NOT* technical support channel.
> >> >> > > > >> >> > >
> >> >> > > > >> >> > > TO GET TECHNICAL SUPPORT send an e-mail directly to
> >> >> > > > >> >> > > SUPPORT {at} amibroker.com <http://amibroker.com/
> >> >> > > <http://amibroker.com/>>
> >> >> > > > >> >> > >
> >> >> > > > >> >> > > TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
> >> >> > > > >> >> > > http://www.amibroker.com/feedback/
> >> >> > > <http://www.amibroker.com/feedback/>
> >> >> > > > >> >> <http://www.amibroker.com/feedback/
> >> >> > > <http://www.amibroker.com/feedback/>>
> >> >> > > > >> >> > > (submissions sent via other channels won't be considered)
> >> >> > > > >> >> > >
> >> >> > > > >> >> > > For NEW RELEASE ANNOUNCEMENTS and other news always check
> >> >> > > DEVLOG:
> >> >> > > > >> >> > > http://www.amibroker.com/devlog/
> >> >> > > <http://www.amibroker.com/devlog/>
> >> >> > > > >> >> <http://www.amibroker.com/devlog/
> >> >> > > <http://www.amibroker.com/devlog/>>
> >> >> > > > >> >> > >
> >> >> > > > >> >> > > Yahoo! Groups Links
> >> >> > > > >> >> > >
> >> >> > > > >> >> > >
> >> >> > > > >> >> > >
> >> >> > > > >> >> > >
> >> >> > > > >> >> >
> >> >> > > > >> >>
> >> >> > > > >> >
> >> >> > > > >> >
> >> >> > > > >> >
> >> >> > > > >> >
> >> >> > > > >>
> >> >> > > > >
> >> >> > > > >
> >> >> > > > >
> >> >> > > > >
> >> >> > > > > ------------------------------------
> >> >> > > > >
> >> >> > > > > **** IMPORTANT PLEASE READ ****
> >> >> > > > > This group is for the discussion between users only.
> >> >> > > > > This is *NOT* technical support channel.
> >> >> > > > >
> >> >> > > > > TO GET TECHNICAL SUPPORT send an e-mail directly to
> >> >> > > > > SUPPORT {at} amibroker.com
> >> >> > > > >
> >> >> > > > > TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
> >> >> > > > > http://www.amibroker.com/feedback/
> >> >> > > <http://www.amibroker.com/feedback/>
> >> >> > > > > (submissions sent via other channels won't be considered)
> >> >> > > > >
> >> >> > > > > For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
> >> >> > > > > http://www.amibroker.com/devlog/ <http://www.amibroker.com/devlog/>
> >> >> > > > >
> >> >> > > > > Yahoo! Groups Links
> >> >> > > > >
> >> >> > > > >
> >> >> > > > >
> >> >> > > >
> >> >> > >
> >> >> > >
> >> >> >
> >> >>
> >> >
> >> >
> >> >
> >> >
> >> > ------------------------------------
> >> >
> >> > **** IMPORTANT PLEASE READ ****
> >> > This group is for the discussion between users only.
> >> > This is *NOT* technical support channel.
> >> >
> >> > TO GET TECHNICAL SUPPORT send an e-mail directly to
> >> > SUPPORT {at} amibroker.com
> >> >
> >> > TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
> >> > http://www.amibroker.com/feedback/
> >> > (submissions sent via other channels won't be considered)
> >> >
> >> > For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
> >> > http://www.amibroker.com/devlog/
> >> >
> >> > Yahoo! Groups Links
> >> >
> >> >
> >> >
> >>
> >
> >
> >
> >
> > ------------------------------------
> >
> > **** IMPORTANT PLEASE READ ****
> > This group is for the discussion between users only.
> > This is *NOT* technical support channel.
> >
> > TO GET TECHNICAL SUPPORT send an e-mail directly to
> > SUPPORT {at} amibroker.com
> >
> > TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
> > http://www.amibroker.com/feedback/
> > (submissions sent via other channels won't be considered)
> >
> > For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
> > http://www.amibroker.com/devlog/
> >
> > Yahoo! Groups Links
> >
> >
> >
>
------------------------------------
**** IMPORTANT PLEASE READ ****
This group is for the discussion between users only.
This is *NOT* technical support channel.
TO GET TECHNICAL SUPPORT send an e-mail directly to
SUPPORT {at} amibroker.com
TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
http://www.amibroker.com/feedback/
(submissions sent via other channels won't be considered)
For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
http://www.amibroker.com/devlog/
Yahoo! Groups Links
<*> To visit your group on the web, go to:
http://groups.yahoo.com/group/amibroker/
<*> Your email settings:
Individual Email | Traditional
<*> To change settings online go to:
http://groups.yahoo.com/group/amibroker/join
(Yahoo! ID required)
<*> To change settings via email:
mailto:amibroker-digest@xxxxxxxxxxxxxxx
mailto:amibroker-fullfeatured@xxxxxxxxxxxxxxx
<*> To unsubscribe from this group, send an email to:
amibroker-unsubscribe@xxxxxxxxxxxxxxx
<*> Your use of Yahoo! Groups is subject to:
http://docs.yahoo.com/info/terms/
|