Hello,
Data tab cache settings recommendations:
"Max MegaBytes" should be set to half of physical RAM installed
(by the way it is set so automatically by AmiBroker), but not more than
2000 MB (2GB).
"Max. symbols" - the best is when it is set to number higher
than number of symbols under test (or in the database),
then subsequent optimizations can work entirely from RAM.
The cost to other programs may be that if they need lots of RAM,
swapping may be excessive when switching tasks.
Best regards,
Tomasz Janeczko
amibroker.com
----- Original Message -----
From: "Mike" <sfclimbers@xxxxxxcom>
To: <amibroker@xxxxxxxxxps.com>
Sent: Tuesday, March 31, 2009 8:29 PM
Subject: [amibroker] Re: OT: Computer recommendation for AB optimizing
> Tomasz,
>
> Can you offer some guidance for what values to use in the "Data"
tab cache settings?
>
> First, what would optimal values be for AmiBroker usage, ignoring
all other programs.
>
> Second, taking into consideration other programs, what is the cost
to other programs as a result of optimal AmiBroker values.
>
> Thanks,
>
> Mike
>
> --- In amibroker@xxxxxxxxxps.com,
"Tomasz Janeczko" <groups@xxx> wrote:
>>
>> Hello,
>>
>> Windows memory manager is unfortunatelly not the best on the
planet.
>> The problem is not the amout of memory, but the fragmentation
that occurs
>> over time.
>> Thats one of the reasons why they rewrote it in Windows 7.
>>
>> What you may do now on Vista is disabling Superfetch Windows
feature as it consumes several
>> gigabytes of your RAM.
>>
>> Also you may go to Tools->Preferences, "Data" tab and
adjust caching settings here.
>>
>> Because of memory manager problems, AmiBroker already uses
custom allocators
>> for some sensitive parts because without that program would
run out of contiguous memory much sooner
>> because of fragmentation (and it did before these allocators
were implemented) .
>> The use of custom allocators will probably be extended in
future.
>>
>> Best regards,
>> Tomasz Janeczko
>> amibroker.com
>> ----- Original Message -----
>> From: "ozzyapeman" <zoopfree@xx.>
>> To: <amibroker@xxxxxxxxxps.com>
>> Sent: Tuesday, March 31, 2009 1:59 AM
>> Subject: [amibroker] Re: OT: Computer recommendation for AB
optimizing
>>
>>
>> > Dang! A bit of a false alarm in being able to run 8
instances in parallel. I had assumed (always a mistake) that the runs
went
>> > smoothly. But when I checked my PC this morning, found
out that the runs did not actually complete. The PC must have crashed
>> > and
>> > rebooted somewhere in between.
>> >
>> > So I restarted, this time, using only 4 instances, and
sat in front of the screen for a few minutes. Indeed, the system crashed
>> > with a "Memory management error"!
>> >
>> > Damn! With 12GB of ram on Vista64 with an i7 processor
(seen as 8 processors by the OS), shouldn't I be able to run 4 measly
>> > instances of AB, each doing an optimization over 2-years
worth of 1-minute data? The total size of my symbol database is only
>> > 156mb.
>> >
>> > It's a new PC with a fresh install, and only Avast anti
virus running at startup. The only other programs installed are AB,
>> > Firefox, Office 2003 and Thunderbird. And when I run AB,
all other programs are closed.
>> >
>> > Is there some memory management utility I can run that
can better allocate memory?
>> >
>> > Or is Vista64 really no better than plain old WinXP32, as
far as being able to run more instances of AB on a single machine? I
>> > thought that one of the main advantages of Vista64 over
XP32 was precisely the ability to make more RAM available for multiple
>> > instances of a program.
>> >
>> >
>> >
>> > --- In amibroker@xxxxxxxxxps.com,
"ozzyapeman" <zoopfree@> wrote:
>> >>
>> >> I was comparing Vista64 to XP32 (which I was using),
not XP64.
>> >>
>> >> I imagine XP64 would probably allow one to run as
many instances of AB as Vista64. But from what I could gather, XP64
seemed
>> >> less
>> >> reliable/stable/supported than Vista64, so I
went with the latter.
>> >>
>> >> Been using Vista64 on an overclocked i7 PC, with 12GB
ddr3 ram now for about a week. Certainly a big difference over my XP32
>> >> install. Yesterday I ran 8 large walk-forward tests
in parallel (1-min databases, several years), no problem. Didn't even
come
>> >> close to maxing out the system. The XP32 install
would tend to hang/crash if I tried 3 such parallel runs.
>> >>
>> >> Will play around with multiple instances over the
next few weeks to see just how far I can push things.
>> >>
>> >> And once I turned off that annoying UAC thing,
haven't noticed any disadvantages yet with Vista. Maybe its bad
reputation was
>> >> only warranted in the first year it was out - with
respect to driver issues and other problems. All that stuff seems to
have
>> >> been
>> >> cleared up in the latest service packs.
>> >>
>> >>
>> >>
>> >> --- In amibroker@xxxxxxxxxps.com,
Keith McCombs <kmccombs@> wrote:
>> >> >
>> >> > Ozzy --
>> >> > What makes you think that, given the same
hardware, Vista64 allows you
>> >> > to run more instances of AB than XP64?
>> >> >
>> >> > TJ --
>> >> > Thanks for your comments on the subject.
Admittedly, I didn't
>> >> > understand how he was doing the testing.
>> >> >
>> >> > All --
>> >> > Once again I would like to suggest:
>> >> > "How about writing some benchmarks in afl? I
assume the code wouldn't
>> >> > have to be very complex, nor would it have to be
for any sort of
>> >> > 'winning' system. Just something that everyone
could run and we could
>> >> > get some comparative speed results." We might
also need to make a
>> >> > static artificial data base so that everyone was
running the same test.
>> >> >
>> >> > That would help many of us when it comes time to
buy a new, or update an
>> >> > older, computer.
>> >> > -- Keith
>> >> >
>> >> > ozzyapeman wrote:
>> >> > >
>> >> > > Thanks for the clarification.
>> >> > >
>> >> > > My understanding then, based on what I can
gather from the net, is
>> >> > > that Windows Vista 64-bit will give me the
sole advantage of allowing
>> >> > > me to run many more instances of AmiBroker,
especially with the i7
>> >> > > processor and 12 GB of RAM, vs on WinXP.
>> >> > >
>> >> > > In that way, I can run more large
optimizations simultaneously,
>> >> > > without running out of memory, thus saving
a lot of time overall.
>> >> > >
>> >> > > I had come across one article that tested
as much, with other 32-bit
>> >> > > apps running on XP32 vs Vista64, and the
difference in multitasking
>> >> > > ability was huge.
>> >> > >
>> >> > > --- In amibroker@xxxxxxxxxps.com
<mailto:amibroker%40yahoogroups.com>,
>> >> > > "Tomasz Janeczko" <groups@> wrote:
>> >> > > >
>> >> > > > Those Windows Vista tests were made
using Microsoft SQL server.
>> >> > > >
>> >> > > > AmiBroker does NOT use Microsoft SQL
server or any other 3rd party DB.
>> >> > > > It uses own original low-level
database that is highly specialized
>> >> > > > for quote processing is pretty
independent from operating system.
>> >> > > > It works equally well on every Windows
version
>> >> > > > (starting from Win95 and ending at
Windows 7).
>> >> > > >
>> >> > > > Best regards,
>> >> > > > Tomasz Janeczko
>> >> > > > amibroker.com
>> >> > > > ----- Original Message -----
>> >> > > > From: "ozzyapeman" <zoopfree@>
>> >> > > > To: <amibroker@xxxxxxxxxps.com
<mailto:amibroker%40yahoogroups.com>>
>> >> > > > Sent: Tuesday, March 17, 2009 7:17 AM
>> >> > > > Subject: [amibroker] Re: OT: Computer
recommendation for AB optimizing
>> >> > > >
>> >> > > >
>> >> > > > > Whoa. Just read that article.
Seems that WinXP 64 makes better
>> >> > > sense by far to drive my new Intel i7 PC.
The speed difference is
>> >> > > > > quite significant. I might have
just wasted money shelling out on
>> >> > > a Vista 64-bit installation disk.
>> >> > > > >
>> >> > > > > Is Amibroker 32-bit pretty stable
on WinXP 64? I only have
>> >> > > experience running it on WinXP 32.
>> >> > > > >
>> >> > > > > If I only plan on running
AmiBroker 5.24, TWS 892, and other basic
>> >> > > 32-bit trading tools on the PC (and maybe
Firefox and Outlook),
>> >> > > > > would WinXP 64 be the way to go,
or are there hidden disadvantages
>> >> > > in going with that OS?
>> >> > > > >
>> >> > > > > I am aiming for the fastest
backtesting platform possible.
>> >> > > > >
>> >> > > > >
>> >> > > > > --- In amibroker@xxxxxxxxxps.com
>> >> > > <mailto:amibroker%40yahoogroups.com>,
Keith McCombs <kmccombs@> wrote:
>> >> > > > >>
>> >> > > > >> Dingo --
>> >> > > > >> Please read
>> >> > > > >>
>> >> > > http://www.infoworld.com/article/09/01/22/03TC-windows-multicore_3.html
>> >> > > <http://www.infoworld.com/article/09/01/22/03TC-windows-multicore_3.html>
>> >> > > > >> for some comparisons between
Vista64 and XP64.
>> >> > > > >> -- Keith
>> >> > > > >>
>> >> > > > >> dingo wrote:
>> >> > > > >> > 50% longer for AB to run
- hardly believable.
>> >> > > > >> >
>> >> > > > >> > d
>> >> > > > >> >
>> >> > > > >> > On Thu, Mar 12, 2009 at
3:51 PM, Keith McCombs <kmccombs@
>> >> > > > >> > <mailto:kmccombs@>>
wrote:
>> >> > > > >> >
>> >> > > > >> > A few personal thoughts:
>> >> > > > >> > 1. The 2.93GHz costs
$470 more than 2.66. I doubt that very many
>> >> > > > >> > of us can tell the
difference without a stopwatch.
>> >> > > > >> >
>> >> > > > >> > 2. I don't know about
running AB, but in many published speed
>> >> > > > >> > tests, Vista64 takes
about 50% longer than XP64.
>> >> > > > >> >
>> >> > > > >> > -- Keith
>> >> > > > >> >
>> >> > > > >> >
>> >> > > > >> > ozzyapeman wrote:
>> >> > > > >> >>
>> >> > > > >> >> Thanks. I was
looking into i7 based-PCs. But aren't all i7's
>> >> > > > >> >> quad-cores to begin
with? And apparently the OS sees an i7 as
>> >> > > > >> >> 8-core due to the
way it's designed.
>> >> > > > >> >>
>> >> > > > >> >> Dell seems to have a
good deal on i7 XPS desktops at 2.93 Ghz
>> >> > > > >> >>
>> >> > > > >> >> --- In amibroker@xxxxxxxxxps.com
>> >> > > <mailto:amibroker%40yahoogroups.com>
>> >> > > > >> >> <mailto:amibroker%40yahoogroups.com>,
dingo <waledingo@> wrote:
>> >> > > > >> >> >
>> >> > > > >> >> > Intel dual core
i7 with fast clock - AB only uses 1 core. 3gig
>> >> > > > >> >> mem. Intel
>> >> > > > >> >> > SLC flash (if
you've got the money otherwise WD Raptor). Medium
>> >> > > > >> >> video card.
>> >> > > > >> >> >
>> >> > > > >> >> >
>> >> > > > >> >> > d
>> >> > > > >> >> >
>> >> > > > >> >> > On Wed, Mar 11,
2009 at 12:57 AM, ozzyapeman <zoopfree@> wrote:
>> >> > > > >> >> >
>> >> > > > >> >> > > I should
add that I need to run exhaustive optimizations, as
>> >> > > > >> >> opposed to
>> >> > > > >> >> > > CMAE or
using Fred's IO, as my variables are discontinuous -
>> >> > > > >> >> not traditional
>> >> > > > >> >> > >
indicator-type variables.
>> >> > > > >> >> > >
>> >> > > > >> >> > > In my
parallel dream life, I run AB Ultra Professional 7.0 on
>> >> > > > >> >> 8 state of
>> >> > > > >> >> > > the art
graphics cards, with thousands of processors, 500,000
>> >> > > > >> >> times faster
>> >> > > > >> >> > > than good
old AB 5.24.
>> >> > > > >> >> > >
>> >> > > > >> >> > > But I
digress. ;-)
>> >> > > > >> >> > >
>> >> > > > >> >> > > In the
real world, what is the best I can do?
>> >> > > > >> >> > >
>> >> > > > >> >> > >
>> >> > > > >> >> > > --- In amibroker@xxxxxxxxxps.com
>> >> > > <mailto:amibroker%40yahoogroups.com>
>> >> > > > >> >> <mailto:amibroker%40yahoogroups.com>,
"ozzyapeman" <zoopfree@>
>> >> > > wrote:
>> >> > > > >> >> > > >
>> >> > > > >> >> > > > Now
that I am just about trading full time, my main PC has
>> >> > > > >> >> become a
>> >> > > > >> >> > > dedicated
trading computer. That only leaves me with a clunky
>> >> > > > >> >> second PC
>> >> > > > >> >> > > (6-years
old) for doing offline optimizing. And it's waaay
>> >> > > > >> >> too slow.
>> >> > > > >> >> > > >
>> >> > > > >> >> > > > So I
am in the market for a new PC, and want to get
>> >> > > > >> >> something powerful,
>> >> > > > >> >> > > but don't
want to overpay for stuff that won't be used. For
>> >> > > > >> >> example, 8GB of
>> >> > > > >> >> > > RAM sounds
great, but if WinXP only uses 4GB (or 3?) then I
>> >> > > > >> >> imagine the
>> >> > > > >> >> > > other 4 GB
just goes to waste?
>> >> > > > >> >> > > >
>> >> > > > >> >> > > > If I
plan to use this PC mainly for offline optimizing and
>> >> > > > >> >> backtesting,
>> >> > > > >> >> > > what are
the recommended specs? I want as much speed as I can
>> >> > > > >> >> possibly get.
>> >> > > > >> >> > > My
optimizations tend to be humongous, taking days on a quad
>> >> > > > >> >> core.
>> >> > > > >> >> > > >
>> >> > > > >> >> > > > Any
hardware gurus please feel free to chime in:
>> >> > > > >> >> > > >
>> >> > > > >> >> > > > - RAM?
>> >> > > > >> >> > > > -
Quad-core vs Eight-core?
>> >> > > > >> >> > > > - OS?
>> >> > > > >> >> > > > - HD
type (flash vs mechanical)?
>> >> > > > >> >> > > > - any
other hardware/software suggestions for increasing
>> >> > > speed?
>> >> > > > >> >> > > >
>> >> > > > >> >> > > >
Thanks!
>> >> > > > >> >> > > >
>> >> > > > >> >> > >
>> >> > > > >> >> > >
>> >> > > > >> >> > >
>> >> > > > >> >> > >
>> >> > > > >> >> > >
------------------------------------
>> >> > > > >> >> > >
>> >> > > > >> >> > > ****
IMPORTANT PLEASE READ ****
>> >> > > > >> >> > > This group
is for the discussion between users only.
>> >> > > > >> >> > > This is
*NOT* technical support channel.
>> >> > > > >> >> > >
>> >> > > > >> >> > > TO GET
TECHNICAL SUPPORT send an e-mail directly to
>> >> > > > >> >> > > SUPPORT
{at} amibroker.com <http://amibroker.com/
>> >> > > <http://amibroker.com/>>
>> >> > > > >> >> > >
>> >> > > > >> >> > > TO SUBMIT
SUGGESTIONS please use FEEDBACK CENTER at
>> >> > > > >> >> > > http://www.amibroker.com/feedback/
>> >> > > <http://www.amibroker.com/feedback/>
>> >> > > > >> >> <http://www.amibroker.com/feedback/
>> >> > > <http://www.amibroker.com/feedback/>>
>> >> > > > >> >> > >
(submissions sent via other channels won't be considered)
>> >> > > > >> >> > >
>> >> > > > >> >> > > For NEW
RELEASE ANNOUNCEMENTS and other news always check
>> >> > > DEVLOG:
>> >> > > > >> >> > > http://www.amibroker.com/devlog/
>> >> > > <http://www.amibroker.com/devlog/>
>> >> > > > >> >> <http://www.amibroker.com/devlog/
>> >> > > <http://www.amibroker.com/devlog/>>
>> >> > > > >> >> > >
>> >> > > > >> >> > > Yahoo!
Groups Links
>> >> > > > >> >> > >
>> >> > > > >> >> > >
>> >> > > > >> >> > >
>> >> > > > >> >> > >
>> >> > > > >> >> >
>> >> > > > >> >>
>> >> > > > >> >
>> >> > > > >> >
>> >> > > > >> >
>> >> > > > >> >
>> >> > > > >>
>> >> > > > >
>> >> > > > >
>> >> > > > >
>> >> > > > >
>> >> > > > > ------------------------------------
>> >> > > > >
>> >> > > > > **** IMPORTANT PLEASE READ ****
>> >> > > > > This group is for the discussion
between users only.
>> >> > > > > This is *NOT* technical support
channel.
>> >> > > > >
>> >> > > > > TO GET TECHNICAL SUPPORT send an
e-mail directly to
>> >> > > > > SUPPORT {at} amibroker.com
>> >> > > > >
>> >> > > > > TO SUBMIT SUGGESTIONS please use
FEEDBACK CENTER at
>> >> > > > > http://www.amibroker.com/feedback/
>> >> > > <http://www.amibroker.com/feedback/>
>> >> > > > > (submissions sent via other
channels won't be considered)
>> >> > > > >
>> >> > > > > For NEW RELEASE ANNOUNCEMENTS and
other news always check DEVLOG:
>> >> > > > > http://www.amibroker.com/devlog/
<http://www.amibroker.com/devlog/>
>> >> > > > >
>> >> > > > > Yahoo! Groups Links
>> >> > > > >
>> >> > > > >
>> >> > > > >
>> >> > > >
>> >> > >
>> >> > >
>> >> >
>> >>
>> >
>> >
>> >
>> >
>> > ------------------------------------
>> >
>> > **** IMPORTANT PLEASE READ ****
>> > This group is for the discussion between users only.
>> > This is *NOT* technical support channel.
>> >
>> > TO GET TECHNICAL SUPPORT send an e-mail directly to
>> > SUPPORT {at} amibroker.com
>> >
>> > TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
>> > http://www.amibroker.com/feedback/
>> > (submissions sent via other channels won't be considered)
>> >
>> > For NEW RELEASE ANNOUNCEMENTS and other news always check
DEVLOG:
>> > http://www.amibroker.com/devlog/
>> >
>> > Yahoo! Groups Links
>> >
>> >
>> >
>>
>
>
>
>
> ------------------------------------
>
> **** IMPORTANT PLEASE READ ****
> This group is for the discussion between users only.
> This is *NOT* technical support channel.
>
> TO GET TECHNICAL SUPPORT send an e-mail directly to
> SUPPORT {at} amibroker.com
>
> TO SUBMIT SUGGESTIONS please use FEEDBACK CENTER at
> http://www.amibroker.com/feedback/
> (submissions sent via other channels won't be considered)
>
> For NEW RELEASE ANNOUNCEMENTS and other news always check DEVLOG:
> http://www.amibroker.com/devlog/
>
> Yahoo! Groups Links
>
>
>