Any way to exempt one project from suspending tasks?

Message boards : Questions and problems : Any way to exempt one project from suspending tasks?
Message board moderation

To post messages, you must log in.

AuthorMessage
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 5077
United Kingdom
Message 102401 - Posted: 4 Jan 2021, 14:53:37 UTC

I think I'd constrain the Primegrid task to say 20 threads using app_config.xml, and let CPDN have continuous use of one (or more) of the remaining cores.
ID: 102401 · Report as offensive
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 5077
United Kingdom
Message 102405 - Posted: 4 Jan 2021, 15:24:53 UTC - in response to Message 102403.  

The 24 core tasks often don't fully utilise all the cores anyway.
Precisely. The more cores you have working in parallel, the longer you have to wait at the synchronisation points for the laggards to catch up. I'd even suggest two PG tasks at 10 threads each, plus 4 spare cores for anything else. Keep away from multiples of 4 or 6, else PG will fill the beast and you're back to square 1.
ID: 102405 · Report as offensive
Profile Dave
Help desk expert

Send message
Joined: 28 Jun 10
Posts: 2518
United Kingdom
Message 102407 - Posted: 4 Jan 2021, 16:11:37 UTC - in response to Message 102406.  

The 24 core tasks often don't fully utilise all the cores anyway.
Precisely. The more cores you have working in parallel, the longer you have to wait at the synchronisation points for the laggards to catch up. I'd even suggest two PG tasks at 10 threads each, plus 4 spare cores for anything else. Keep away from multiples of 4 or 6, else PG will fill the beast and you're back to square 1.
The CPDN moderators have told me it should be ok to suspend them as long as they're left in memory, so I'm not sure why they're crashing. I have all my computers set to leave applications in memory when suspended.

PG does actually use about 22 of 24 cores on average, which is good enough. And since that will disable HT sometimes, and also allow the CPU to engage a higher turbo gear, presumably I'm not even losing those 2 cores in their entirety.


I am assuming all your tasks are from the latest safr (South Africa region) batch, statistics for which are as follows,
Success: 203 (6%)
Fails: 4397 (126%)
Hard Fail: 711 (20%)
Running: 2576 (74%)
Unsent: 0 (0%)

Hard fail means failed on all three attempts. Of those that have crashed on one computer and succeeded on another, they seem mostly to be successful on a different CPU type to the one where they crashed. AMD cpus seem to be crashing slightly more/cpu but I have not looked closely enough to see if this is statistically significant.

Bottom line is the crashes may be nothing to do with suspending the tasks. I would even go so far as to say probably nothing to do with it.
ID: 102407 · Report as offensive
Profile Dave
Help desk expert

Send message
Joined: 28 Jun 10
Posts: 2518
United Kingdom
Message 102413 - Posted: 4 Jan 2021, 21:29:29 UTC - in response to Message 102408.  

As for AMD/Intel, I'm not so sure. I have one AMD (a new Ryzen) and 6 Intels (only the 5 older ones managed to get CPDN tasks). All have been equally unreliable.


I did add the caveat that what I had looked at may not be statistically significant. In the absence of anyone with greater script writing skills and more time than I have to look at the issue and pull the relevant data from the servers, it will stay not statistically significant. I saw the email that I posted the contents of just after I posted here.
ID: 102413 · Report as offensive

Message boards : Questions and problems : Any way to exempt one project from suspending tasks?

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.