Looking for memory-intensive projects

Message boards : Projects : Looking for memory-intensive projects
Message board moderation

To post messages, you must log in.

AuthorMessage
mage0

Send message
Joined: 28 Mar 22
Posts: 2
Message 107595 - Posted: 28 Mar 2022, 4:24:06 UTC
Last modified: 28 Mar 2022, 4:25:10 UTC

Have some large-memory machines (64GB and up) here. Anyone recommend a project that would benefit from the extra headroom?
ID: 107595 · Report as offensive
Profile Keith Myers
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 17 Nov 16
Posts: 863
United States
Message 107596 - Posted: 28 Mar 2022, 4:37:24 UTC - in response to Message 107595.  

Rosetta uses 3.5GB per task occasionally.


ID: 107596 · Report as offensive
computezrmle

Send message
Joined: 2 Feb 22
Posts: 81
Germany
Message 107597 - Posted: 28 Mar 2022, 5:38:55 UTC - in response to Message 107595.  

Basically most VirtualBox projects as they set up a complete VM per task.
Keith already mentioned Rosetta which is a very good example.
You may also add LHC@home (ATLAS, CMS) to your candidate list.

Depending on the number of CPU cores per computer you may even need more than 64 GB RAM.
ID: 107597 · Report as offensive
Profile Dave
Help desk expert

Send message
Joined: 28 Jun 10
Posts: 2517
United Kingdom
Message 107598 - Posted: 28 Mar 2022, 7:28:39 UTC

I still have no idea when they will be out of testing but OpenIFS tasks from CPDN have taken upwards of 6GB/task. If they do move eventually to that model type for most Linux work, it it will also mean the end of having to install 32bit libraries to run tasks. I would expect there to be a lot of noise once they do make it out of testing but it is probably six months away or more.
ID: 107598 · Report as offensive
mage0

Send message
Joined: 28 Mar 22
Posts: 2
Message 107621 - Posted: 29 Mar 2022, 1:38:34 UTC
Last modified: 29 Mar 2022, 1:38:50 UTC

Thanks to all for the great ideas. And, no, my post shouldn't be taken as a sign by developers to consume as much RAM as possible. : )

Has anyone tried to measure the overhead incurred by virtualization vis-a-vis memory or other system resources?
ID: 107621 · Report as offensive
computezrmle

Send message
Joined: 2 Feb 22
Posts: 81
Germany
Message 107623 - Posted: 29 Mar 2022, 5:25:50 UTC - in response to Message 107621.  

To measure the overhead you would need to compare a scientific application running native with the same application running in a VM.
Some examples where you only have a VM app and no native app to compare:
Rosetta
LHC ATLAS/Theory (on Windows)
LHC CMS
QuChemPedIA (not on Linux)

In any case you would have to make yourself familiar with the resource requirements of the app your computer gets.
ID: 107623 · Report as offensive
robsmith
Volunteer tester
Help desk expert

Send message
Joined: 25 May 09
Posts: 1283
United Kingdom
Message 107626 - Posted: 29 Mar 2022, 7:14:49 UTC - in response to Message 107623.  

With Rosetta they don't have the same application in both virtualised and un-virtualised forms which makes the simple comparison very difficult.
ID: 107626 · Report as offensive
computezrmle

Send message
Joined: 2 Feb 22
Posts: 81
Germany
Message 107627 - Posted: 29 Mar 2022, 7:22:53 UTC - in response to Message 107626.  

??
That's exactly what I meant.
"... examples where you only have a VM app and no native app to compare"
ID: 107627 · Report as offensive
ProDigit

Send message
Joined: 8 Nov 19
Posts: 718
United States
Message 107648 - Posted: 30 Mar 2022, 9:47:59 UTC
Last modified: 30 Mar 2022, 9:51:18 UTC

Rosetta, MLC, LHC, Cosmology, Qchempedia, mind modeling....

Also helps if you have more cores (like, some projects like milkyway, can make use of as many cores as you have in a single WU).
ID: 107648 · Report as offensive
Profile Skivelitis2
Avatar

Send message
Joined: 8 Nov 14
Posts: 11
United States
Message 107678 - Posted: 1 Apr 2022, 11:08:56 UTC
Last modified: 1 Apr 2022, 11:14:34 UTC

Pretty good rundown for RAM requirements here
ID: 107678 · Report as offensive

Message boards : Projects : Looking for memory-intensive projects

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.