Swap file size with memory hungry tasks.

Message boards : Questions and problems : Swap file size with memory hungry tasks.
Message board moderation

To post messages, you must log in.

AuthorMessage
Profile Dave
Help desk expert

Send message
Joined: 28 Jun 10
Posts: 2534
United Kingdom
Message 91138 - Posted: 18 Apr 2019, 7:32:39 UTC

Last night I ran a task for a project testing programme where memory usage topped 5GB at times. I imagine that if these tasks make it to the main site, lots of users who like myself, only have the currently recommended 2GB/core will either find tasks slowing down a lot or not be able to use all cores. Would increasing the size of the swap partition (these tasks are Linux only at least for the present) to give enough headroom be enough or are they still likely to run into problems? Swap is on an SSD on this machine.
ID: 91138 · Report as offensive
Dr Who Fan
Avatar

Send message
Joined: 10 May 07
Posts: 1348
United States
Message 91148 - Posted: 19 Apr 2019, 6:04:19 UTC - in response to Message 91138.  

Virtual Memory (SWAP File) is not a replacement for PHYSICAL (real) RAM and would most likely cause at minimum severe thrashing, unresponsive system, tasks not validating and/or a system crash.

Best to limit the number of concurrent tasks running for that project with an app_config.xml file.
ID: 91148 · Report as offensive
Profile Dave
Help desk expert

Send message
Joined: 28 Jun 10
Posts: 2534
United Kingdom
Message 91149 - Posted: 19 Apr 2019, 6:30:02 UTC - in response to Message 91148.  

Thanks. I suspected something like that might be the case. It will be interesting to see how the project copes with it given that there are an awful lot of set and forget crunchers out there and the set and forget crowd are unlikely to have 5GB+/core on their boxen.
ID: 91149 · Report as offensive

Message boards : Questions and problems : Swap file size with memory hungry tasks.

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.