Limit cores used per project?

Message boards : Questions and problems : Limit cores used per project?
Message board moderation

To post messages, you must log in.

AuthorMessage
Peter Hucker of the Scottish B...
Avatar

Send message
Joined: 6 Oct 06
Posts: 1499
United Kingdom
Message 106517 - Posted: 25 Dec 2021, 14:05:09 UTC
Last modified: 25 Dec 2021, 14:06:18 UTC

I'm aware of:

max_concurrent
The maximum number of tasks of this application to run at a given time.

project_max_concurrent
A limit on the number of running jobs for this project.

But I'm wondering if there's something similar. I run the LHC project on a 24 thread Ryzen CPU. They use virtualbox for everything, but using all the threads on virtualbox makes the interface sluggish. Is there any way to limit the number of threads that can use LHC (or that can use virtualbox) to 16, letting the other 8 run another project that doesn't use virtualbox? I can't use project_max_concurrent as they have tasks that are single thread and tasks that are 8 thread. I want the total threads not to exceed 16.
ID: 106517 · Report as offensive
Harri Liljeroos

Send message
Joined: 25 Jul 18
Posts: 35
Finland
Message 106523 - Posted: 25 Dec 2021, 23:08:00 UTC

I don't know if this works but there are different venues available also for computing preferences where you set the percentage of CPU cores allowed to be used by Boinc. If you setup the host in LHC to venue Home and set the CPU percentage that matches 16 cores and on the other project you setup the same Host to School with 100% of CPU cores. That could possibly result 16 cores for LHC and the rest on other project. The other project may sometimes block the LHC completely. I don't know if this works or not, you have to try it yourself.
ID: 106523 · Report as offensive
Bryn Mawr
Help desk expert

Send message
Joined: 31 Dec 18
Posts: 229
United Kingdom
Message 106534 - Posted: 26 Dec 2021, 11:55:09 UTC - in response to Message 106523.  

I don't know if this works but there are different venues available also for computing preferences where you set the percentage of CPU cores allowed to be used by Boinc. If you setup the host in LHC to venue Home and set the CPU percentage that matches 16 cores and on the other project you setup the same Host to School with 100% of CPU cores. That could possibly result 16 cores for LHC and the rest on other project. The other project may sometimes block the LHC completely. I don't know if this works or not, you have to try it yourself.


I don’t think that will work. As I understand it Boinc chooses one set of preferences, either local or from one of the projects and applies that to all projects. Thus, a single host cannot be both home and school, nor can it have 67% and 100% at the same time.
ID: 106534 · Report as offensive
Peter Hucker of the Scottish B...
Avatar

Send message
Joined: 6 Oct 06
Posts: 1499
United Kingdom
Message 106539 - Posted: 26 Dec 2021, 17:33:31 UTC - in response to Message 106534.  

I don't know if this works but there are different venues available also for computing preferences where you set the percentage of CPU cores allowed to be used by Boinc. If you setup the host in LHC to venue Home and set the CPU percentage that matches 16 cores and on the other project you setup the same Host to School with 100% of CPU cores. That could possibly result 16 cores for LHC and the rest on other project. The other project may sometimes block the LHC completely. I don't know if this works or not, you have to try it yourself.


I don’t think that will work. As I understand it Boinc chooses one set of preferences, either local or from one of the projects and applies that to all projects. Thus, a single host cannot be both home and school, nor can it have 67% and 100% at the same time.


It can be home and school. I've got machines in all sorts of different venues for different projects, to limit which subprojects run or whether the GPU is used there.

But you're right, I don't think I can have two different CPU percentages.
ID: 106539 · Report as offensive
Bryn Mawr
Help desk expert

Send message
Joined: 31 Dec 18
Posts: 229
United Kingdom
Message 106542 - Posted: 26 Dec 2021, 20:20:23 UTC - in response to Message 106539.  

I don't know if this works but there are different venues available also for computing preferences where you set the percentage of CPU cores allowed to be used by Boinc. If you setup the host in LHC to venue Home and set the CPU percentage that matches 16 cores and on the other project you setup the same Host to School with 100% of CPU cores. That could possibly result 16 cores for LHC and the rest on other project. The other project may sometimes block the LHC completely. I don't know if this works or not, you have to try it yourself.


I don’t think that will work. As I understand it Boinc chooses one set of preferences, either local or from one of the projects and applies that to all projects. Thus, a single host cannot be both home and school, nor can it have 67% and 100% at the same time.


It can be home and school. I've got machines in all sorts of different venues for different projects, to limit which subprojects run or whether the GPU is used there.

But you're right, I don't think I can have two different CPU percentages.


If it can be the first then it can have the second.

A single instance of the Boing client can only have one active profile at any one time - yes, you can have many different profiles set up within the different projects but only one can be active.
ID: 106542 · Report as offensive
Les Bayliss
Help desk expert

Send message
Joined: 25 Nov 05
Posts: 1637
Australia
Message 106543 - Posted: 26 Dec 2021, 23:04:10 UTC - in response to Message 106517.  
Last modified: 26 Dec 2021, 23:04:50 UTC

Peter

I'm not familiar with LH, or virtualbox, but this post in Boinc memory estimate and LHC Settings seems to be talking about your question.
ID: 106543 · Report as offensive
Peter Hucker of the Scottish B...
Avatar

Send message
Joined: 6 Oct 06
Posts: 1499
United Kingdom
Message 106556 - Posted: 27 Dec 2021, 19:12:52 UTC - in response to Message 106543.  

Peter

I'm not familiar with LH, or virtualbox, but this post in Boinc memory estimate and LHC Settings seems to be talking about your question.


The problem I have (which I don't think they solve there) is LHC has 8-thread and 1-thread apps. I want to limit my 24-thread machine to run a maximum of 16 threads of LHC work. These are some of the valid options I'd be happy running (depending on what they happen to send out):

2 of 8 thread Atlas
16 of 1 thread Theory
1 of 8 thread Atlas and 8 of 1 thread Theory

But I can only tell Boinc to limit the total number of tasks for LHC, and the number of tasks for one app.

If I use project_max_concurrent, I need to set it to 16, so 16 Theory can run.
If I use max_concurrent, I need to set 2 to Atlas, and 16 to Theory.

Even doing both of these, it could end up running 2 Atlas and 8 Theory = 24 threads.
ID: 106556 · Report as offensive
Peter Hucker of the Scottish B...
Avatar

Send message
Joined: 6 Oct 06
Posts: 1499
United Kingdom
Message 106557 - Posted: 27 Dec 2021, 19:15:44 UTC - in response to Message 106542.  

I don't know if this works but there are different venues available also for computing preferences where you set the percentage of CPU cores allowed to be used by Boinc. If you setup the host in LHC to venue Home and set the CPU percentage that matches 16 cores and on the other project you setup the same Host to School with 100% of CPU cores. That could possibly result 16 cores for LHC and the rest on other project. The other project may sometimes block the LHC completely. I don't know if this works or not, you have to try it yourself.


I don’t think that will work. As I understand it Boinc chooses one set of preferences, either local or from one of the projects and applies that to all projects. Thus, a single host cannot be both home and school, nor can it have 67% and 100% at the same time.


It can be home and school. I've got machines in all sorts of different venues for different projects, to limit which subprojects run or whether the GPU is used there.

But you're right, I don't think I can have two different CPU percentages.


If it can be the first then it can have the second.

A single instance of the Boing client can only have one active profile at any one time - yes, you can have many different profiles set up within the different projects but only one can be active.


I disagree with your last sentence. I have Einstein set to only give my Ryzen gamma tasks, as the GPU can't cope with the others, Einstein has it in the school venue. I have LHC set to give it Atlas tasks, that is in the home venue. The venues are project controlled, the client has no knowledge of them (or doesn't care). When it asks Einstein for work, Einstein knows it's in school, and gives it gamma tasks. In fact Primegrid has more than the standard 4 venues.
ID: 106557 · Report as offensive
Bryn Mawr
Help desk expert

Send message
Joined: 31 Dec 18
Posts: 229
United Kingdom
Message 106565 - Posted: 27 Dec 2021, 22:44:12 UTC - in response to Message 106557.  

I don't know if this works but there are different venues available also for computing preferences where you set the percentage of CPU cores allowed to be used by Boinc. If you setup the host in LHC to venue Home and set the CPU percentage that matches 16 cores and on the other project you setup the same Host to School with 100% of CPU cores. That could possibly result 16 cores for LHC and the rest on other project. The other project may sometimes block the LHC completely. I don't know if this works or not, you have to try it yourself.


I don’t think that will work. As I understand it Boinc chooses one set of preferences, either local or from one of the projects and applies that to all projects. Thus, a single host cannot be both home and school, nor can it have 67% and 100% at the same time.


It can be home and school. I've got machines in all sorts of different venues for different projects, to limit which subprojects run or whether the GPU is used there.

But you're right, I don't think I can have two different CPU percentages.


If it can be the first then it can have the second.

A single instance of the Boing client can only have one active profile at any one time - yes, you can have many different profiles set up within the different projects but only one can be active.


I disagree with your last sentence. I have Einstein set to only give my Ryzen gamma tasks, as the GPU can't cope with the others, Einstein has it in the school venue. I have LHC set to give it Atlas tasks, that is in the home venue. The venues are project controlled, the client has no knowledge of them (or doesn't care). When it asks Einstein for work, Einstein knows it's in school, and gives it gamma tasks. In fact Primegrid has more than the standard 4 venues.



Each project has separate project level parameters such as which type of tasks it is to send you - only Einstein knows about Gamma tasks and only LHC knows about Atlas tasks.

Then there are the Boinc parameters such as the %CPU to use. These make up your profile and you can only have one active profile at any time.
ID: 106565 · Report as offensive
Peter Hucker of the Scottish B...
Avatar

Send message
Joined: 6 Oct 06
Posts: 1499
United Kingdom
Message 106567 - Posted: 27 Dec 2021, 22:46:57 UTC - in response to Message 106565.  

Ah, I only set project specific things on their websites. CPU percentage etc is done locally. Seems neater that way.
ID: 106567 · Report as offensive
Bryn Mawr
Help desk expert

Send message
Joined: 31 Dec 18
Posts: 229
United Kingdom
Message 106569 - Posted: 27 Dec 2021, 22:52:02 UTC - in response to Message 106567.  

Ah, I only set project specific things on their websites. CPU percentage etc is done locally. Seems neater that way.


Then your location is the one in you local profile and is fixed for that instance of Boinc on that machine.
ID: 106569 · Report as offensive
Peter Hucker of the Scottish B...
Avatar

Send message
Joined: 6 Oct 06
Posts: 1499
United Kingdom
Message 106572 - Posted: 27 Dec 2021, 22:54:28 UTC - in response to Message 106569.  

Ah, I only set project specific things on their websites. CPU percentage etc is done locally. Seems neater that way.


Then your location is the one in you local profile and is fixed for that instance of Boinc on that machine.


By location, do you mean "school/home/work"? Because this machine is in all of those for different projects.
ID: 106572 · Report as offensive
Bryn Mawr
Help desk expert

Send message
Joined: 31 Dec 18
Posts: 229
United Kingdom
Message 106574 - Posted: 27 Dec 2021, 23:01:12 UTC - in response to Message 106572.  

Ah, I only set project specific things on their websites. CPU percentage etc is done locally. Seems neater that way.


Then your location is the one in you local profile and is fixed for that instance of Boinc on that machine.


By location, do you mean "school/home/work"? Because this machine is in all of those for different projects.


But the location is part of the computing preference that you say you have set to local rather than the project preferences that vary according to project.

Regardless of the value you have set on each of the project’s websites the Boinc client will only take note of the one value in the active profile.
ID: 106574 · Report as offensive
Peter Hucker of the Scottish B...
Avatar

Send message
Joined: 6 Oct 06
Posts: 1499
United Kingdom
Message 106575 - Posted: 27 Dec 2021, 23:08:17 UTC - in response to Message 106574.  

Well it seems to work. So my computer is set to say school, locally. But it still obeys the home settings in say Einstein to not get gravity tasks.
ID: 106575 · Report as offensive
Bryn Mawr
Help desk expert

Send message
Joined: 31 Dec 18
Posts: 229
United Kingdom
Message 106576 - Posted: 27 Dec 2021, 23:10:11 UTC - in response to Message 106575.  

Well it seems to work. So my computer is set to say school, locally. But it still obeys the home settings in say Einstein to not get gravity tasks.


Because the type of task is a project level setting, not a computing preference determined by the machines location.
ID: 106576 · Report as offensive
Profile Keith Myers
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 17 Nov 16
Posts: 712
United States
Message 106580 - Posted: 28 Dec 2021, 0:37:41 UTC - in response to Message 106572.  

Use the Combined View to see all your project setting across all venues. Helps clear up confusion about which applications are being selected for each venue.
https://einsteinathome.org/account/prefs/project/combined
ID: 106580 · Report as offensive

Message boards : Questions and problems : Limit cores used per project?

Copyright © 2022 University of California. Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.