What is "too many runnable tasks"?

Message boards : Questions and problems : What is "too many runnable tasks"?
Message board moderation

To post messages, you must log in.

AuthorMessage
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 5077
United Kingdom
Message 110848 - Posted: 2 Jan 2023, 14:08:00 UTC - in response to Message 110847.  

It'll be a local BOINC client decision. The clue is in the "Not requesting ..." - that's a client decision.

The project server isn't involved, so you probably asked for 101 tasks at a moment when you had 999 runnable, or something like that.

The question is: why? The purpose would be to stop BOINC wasting computer power on housekeeping, when you could be doing science. And it helps the scientists get their research back in a timely fashion.
ID: 110848 · Report as offensive
Profile Keith Myers
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 17 Nov 16
Posts: 863
United States
Message 110865 - Posted: 4 Jan 2023, 3:38:25 UTC - in response to Message 110853.  

There is a hard limit in the client code of 1000 tasks per host.

work_fetch.cpp module

https://github.com/BOINC/boinc/blob/5dead4107b4c379769b65174136ad2d709b56248/client/work_fetch.cpp#L664-L665


ID: 110865 · Report as offensive
Profile Dave
Help desk expert

Send message
Joined: 28 Jun 10
Posts: 2516
United Kingdom
Message 110867 - Posted: 4 Jan 2023, 8:10:14 UTC - in response to Message 110865.  

There is a hard limit in the client code of 1000 tasks per host.

work_fetch.cpp module

https://github.com/BOINC/boinc/blob/5dead4107b4c379769b65174136ad2d709b56248/client/work_fetch.cpp#L664-L665
Presumably, not a horrendous task for someone who rolls their own to increase that?
ID: 110867 · Report as offensive
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 5077
United Kingdom
Message 110868 - Posted: 4 Jan 2023, 9:35:26 UTC - in response to Message 110867.  

Presumably, not a horrendous task for someone who rolls their own to increase that?
Make sure you read the full context of that change. That makes it even easier!

- Make max runnable jobs (1000) into a #define
(from https://github.com/BOINC/boinc/commit/40f0cb44f4fcd11eb2789408dfc868de63e42242)

https://github.com/BOINC/boinc/blob/master/client/client_state.h#L613
ID: 110868 · Report as offensive
Profile Keith Myers
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 17 Nov 16
Posts: 863
United States
Message 110877 - Posted: 4 Jan 2023, 23:08:20 UTC - in response to Message 110867.  

There is a hard limit in the client code of 1000 tasks per host.

work_fetch.cpp module

https://github.com/BOINC/boinc/blob/5dead4107b4c379769b65174136ad2d709b56248/client/work_fetch.cpp#L664-L665
Presumably, not a horrendous task for someone who rolls their own to increase that?

Absolutely, back when we were doing Seti, we used to just pop in an extra zero for the limit since we were compiling our own custom client. That made the limit 10K since we could easily crunch more than that in a day with the custom app.


ID: 110877 · Report as offensive
Profile Keith Myers
Volunteer tester
Help desk expert
Avatar

Send message
Joined: 17 Nov 16
Posts: 863
United States
Message 110879 - Posted: 4 Jan 2023, 23:15:52 UTC - in response to Message 110878.  

Yes, MW still has its own server hard limit of 900 tasks per host. Can't get around that on the client side.

But if your host is running 4-7 gpus on multiple projects, you really need to get around the default client limit if your gpu tasks in general are crunched in under a minute for all projects.


ID: 110879 · Report as offensive

Message boards : Questions and problems : What is "too many runnable tasks"?

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.