Hosting a medium-sized grid

classic Classic list List threaded Threaded
9 messages Options
Reply | Threaded
Open this post in threaded view
|

Hosting a medium-sized grid

Jeff Kelley
I'm porting a grid from a home PC to a server.

The grid is 40 regions large, 16 simulators, 5 to 10 avatars.

It runs today on a i7-2700K (8,921 PassMarks), 16Gb home PC.

A quick test on a 16Gb Xeon gives these stats:

top - 17:49:03 up 14 days,  7:04, 19 users,  load average: 0.40, 0.64, 0.77
Tasks: 208 total,   2 running, 206 sleeping,   0 stopped,   0 zombie
%Cpu(s):  9.8 us,  1.5 sy,  0.0 ni, 88.4 id,  0.2 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem:  16483288 total, 16185604 used,   297684 free,   456872 buffers
KiB Swap:   523260 total,    29192 used,   494068 free.  4718744 cached Mem

              total       used       free     shared    buffers     cached
Mem:           15G        15G       318M        37M       446M       4.5G
-/+ buffers/cache:        10G       5.2G
Swap:         510M        28M       482M


The grid runs quite well but 16Gb is a little short, so I will go for
a 24 or 32Gb machine. This is (obviously, or I won't ask here) a
non-profit project, on a personal budget.

Here is my dilemma : in the target price range, I can have two machines:

- Two Xeon E5530 (7,723 PassMarks), 8 core total, 24Gb, rotating disk
- Single Xeon E3 1225v2 (6,844 PassMarks), 4 core, 32Gb, 3x120Gb SSD

Should I favour CPU over memory? Memory over SSD?

Which one would you pick?



-- Jeff
_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
Reply | Threaded
Open this post in threaded view
|

Re: Hosting a medium-sized grid

Dahlia Trimble
Looks to me like you have almost 5 gb free ram.

http://www.linuxatemyram.com/


On Fri, Sep 19, 2014 at 9:07 AM, Jeff Kelley <[hidden email]> wrote:
I'm porting a grid from a home PC to a server.

The grid is 40 regions large, 16 simulators, 5 to 10 avatars.

It runs today on a i7-2700K (8,921 PassMarks), 16Gb home PC.

A quick test on a 16Gb Xeon gives these stats:

top - 17:49:03 up 14 days,  7:04, 19 users,  load average: 0.40, 0.64, 0.77
Tasks: 208 total,   2 running, 206 sleeping,   0 stopped,   0 zombie
%Cpu(s):  9.8 us,  1.5 sy,  0.0 ni, 88.4 id,  0.2 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem:  16483288 total, 16185604 used,   297684 free,   456872 buffers
KiB Swap:   523260 total,    29192 used,   494068 free.  4718744 cached Mem

             total       used       free     shared    buffers     cached
Mem:           15G        15G       318M        37M       446M       4.5G
-/+ buffers/cache:        10G       5.2G
Swap:         510M        28M       482M


The grid runs quite well but 16Gb is a little short, so I will go for a 24 or 32Gb machine. This is (obviously, or I won't ask here) a non-profit project, on a personal budget.

Here is my dilemma : in the target price range, I can have two machines:

- Two Xeon E5530 (7,723 PassMarks), 8 core total, 24Gb, rotating disk
- Single Xeon E3 1225v2 (6,844 PassMarks), 4 core, 32Gb, 3x120Gb SSD

Should I favour CPU over memory? Memory over SSD?

Which one would you pick?



-- Jeff
_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users


_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
Reply | Threaded
Open this post in threaded view
|

Re: Hosting a medium-sized grid

Jeff Kelley
At 1:01 PM -0700 19/9/14, Dahlia Trimble wrote:

>  Looks to me like you have almost 5 gb free ram.

              total       used       free     shared    buffers     cached
Mem:           15G        15G       318M        37M       446M       4.5G
-/+ buffers/cache:        10G       5.2G
Swap:         510M        28M       482M

Those 5.2 G are allocated and not used?


-- Jeff
_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
Reply | Threaded
Open this post in threaded view
|

Re: Hosting a medium-sized grid

Michael Emory Cerquoni
In reply to this post by Dahlia Trimble
chances are even if you had 128gb ram, linux would allocate most of it and on the surface it will look like its being used, but the cache is low priority and anything requiring more memory will instantly take from the cache pool, so yes you have 5.2gb available for the system to use still.

On Fri, Sep 19, 2014 at 6:42 PM, Jeff Kelley <[hidden email]> wrote:
At 1:01 PM -0700 19/9/14, Dahlia Trimble wrote:

 Looks to me like you have almost 5 gb free ram.

             total       used       free     shared    buffers     cached
Mem:           15G        15G       318M        37M       446M       4.5G
-/+ buffers/cache:        10G       5.2G
Swap:         510M        28M       482M

Those 5.2 G are allocated and not used?



-- Jeff
_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users



--
Michael Emory Cerquoni

_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
Reply | Threaded
Open this post in threaded view
|

Re: Hosting a medium-sized grid

Jeff Kelley
At 6:57 PM -0400 19/9/14, Michael Emory Cerquoni wrote:

>chances are even if you had 128gb ram, linux would allocate most of it and on
>the surface it will look like its being used,
>but the cache is low priority and anything
>requiring more memory will instantly take from the cache pool, so yes you have
>5.2gb available for the system to use still.


Ah ok. That's the « Linux ate my ram » story. It
allocates as much cache as it can then releases
it when needed. So the available 5.2G will be
mainly for the asset cache, until some process
claims more memory. 16Gigs seems enough, however
I will feel better with some spare RAM for future
extensions.


Thanks Dahlia, thanks Michael.


-- Jeff
_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
Reply | Threaded
Open this post in threaded view
|

Re: Hosting a medium-sized grid

M.E. Verhagen
In reply to this post by Michael Emory Cerquoni
I would definitely go for an ssd over a normal hdd. 
A lot of memory is not bad. Not used memory will not hurt

I do not know how important a cpu is for opensim performance.



_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
Reply | Threaded
Open this post in threaded view
|

Re: Hosting a medium-sized grid

Jeff Kelley
At 2:40 AM +0200 20/9/14, M.E. Verhagen wrote:

>  I would definitely go for an ssd over a normal hdd.

Yes. SSD is cool and makes the assets cache happy. I mount them with

   mount -o remount,discard,relatime,nodiratime /

to squeeze a bit more out of them. The machine I target has 3x120Gb,
way enough for the grid. I hope it will be able to welcome more HG
visitors, then.


-- Jeff

_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
Reply | Threaded
Open this post in threaded view
|

Re: Hosting a medium-sized grid

justincc
In reply to this post by Jeff Kelley
I would tend to favour CPU, though disk can also be important with all the assets being read from it.  Memory is usually
not an issue.

On 19/09/14 17:07, Jeff Kelley wrote:

> I'm porting a grid from a home PC to a server.
>
> The grid is 40 regions large, 16 simulators, 5 to 10 avatars.
>
> It runs today on a i7-2700K (8,921 PassMarks), 16Gb home PC.
>
> A quick test on a 16Gb Xeon gives these stats:
>
> top - 17:49:03 up 14 days,  7:04, 19 users,  load average: 0.40, 0.64, 0.77
> Tasks: 208 total,   2 running, 206 sleeping,   0 stopped,   0 zombie
> %Cpu(s):  9.8 us,  1.5 sy,  0.0 ni, 88.4 id,  0.2 wa,  0.0 hi,  0.0 si,  0.0 st
> KiB Mem:  16483288 total, 16185604 used,   297684 free,   456872 buffers
> KiB Swap:   523260 total,    29192 used,   494068 free.  4718744 cached Mem
>
>               total       used       free     shared    buffers     cached
> Mem:           15G        15G       318M        37M       446M       4.5G
> -/+ buffers/cache:        10G       5.2G
> Swap:         510M        28M       482M
>
>
> The grid runs quite well but 16Gb is a little short, so I will go for a 24 or 32Gb machine. This is (obviously, or I
> won't ask here) a non-profit project, on a personal budget.
>
> Here is my dilemma : in the target price range, I can have two machines:
>
> - Two Xeon E5530 (7,723 PassMarks), 8 core total, 24Gb, rotating disk
> - Single Xeon E3 1225v2 (6,844 PassMarks), 4 core, 32Gb, 3x120Gb SSD
>
> Should I favour CPU over memory? Memory over SSD?
>
> Which one would you pick?
>
>
>
> -- Jeff
> _______________________________________________
> Opensim-users mailing list
> [hidden email]
> http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
>


--
Justin Clark-Casey (justincc)
OSVW Consulting
http://justincc.org
http://twitter.com/justincc
_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users
Reply | Threaded
Open this post in threaded view
|

Re: Hosting a medium-sized grid (UNCLASSIFIED)

Maxwell, Douglas CIV (US)
In reply to this post by Michael Emory Cerquoni
Classification: UNCLASSIFIED
Caveats: NONE

We allocate 64Gb of ram to each of our MOSES VMs and rarely see more than 30%
utilized under load.  Referring to the attached screenshot, you can see the
first VM is only using ~8Gb ram with 10 sims allocated to it.

v/r -douglas

Douglas Maxwell, MSME
Science and Technology Manager
Virtual World Strategic Applications
U.S. Army Research Lab
Simulation & Training Technology Center (STTC)
(c) (407) 242-0209



-----Original Message-----
From: [hidden email]
[mailto:[hidden email]] On Behalf Of Michael Emory
Cerquoni
Sent: Friday, September 19, 2014 6:58 PM
To: [hidden email]
Subject: Re: [Opensim-users] Hosting a medium-sized grid

chances are even if you had 128gb ram, linux would allocate most of it and on
the surface it will look like its being used, but the cache is low priority
and anything requiring more memory will instantly take from the cache pool, so
yes you have 5.2gb available for the system to use still.


On Fri, Sep 19, 2014 at 6:42 PM, Jeff Kelley <[hidden email]> wrote:


        At 1:01 PM -0700 19/9/14, Dahlia Trimble wrote:



                 Looks to me like you have almost 5 gb free ram.



                     total       used       free     shared    buffers     cached
        Mem:           15G        15G       318M        37M       446M       4.5G
        -/+ buffers/cache:        10G       5.2G
        Swap:         510M        28M       482M

        Those 5.2 G are allocated and not used?



        -- Jeff
        _______________________________________________
        Opensim-users mailing list
        [hidden email]
<blockedmailto:[hidden email]>
        http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users 
<blockedhttp://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users>





--
Michael Emory Cerquoni

Classification: UNCLASSIFIED
Caveats: NONE



_______________________________________________
Opensim-users mailing list
[hidden email]
http://opensimulator.org/cgi-bin/mailman/listinfo/opensim-users

MGM Resources.png (88K) Download Attachment
smime.p7s (7K) Download Attachment