Thread 'Questions about -exit_when_idle and -return_results_immediately'

Message boards : BOINC client : Questions about -exit_when_idle and -return_results_immediately
Message board moderation

To post messages, you must log in.

AuthorMessage
brentwg

Send message
Joined: 9 Feb 07
Posts: 6
Canada
Message 8091 - Posted: 9 Feb 2007, 6:03:07 UTC

I'm sorry if this has been posted before; however, I didn't find anything directly applicable in my searches (here, google, or otherwise).

I don't understand the "-exit_when_idle" and "-return_results_immediately" flags. Here is what I expect to happen:

I execute the code, download a data package, process the package, upload the results, and quit.

But this doesn't seem to be the case. After the package is processed, the main executable exits but boinc is still running, doing, as far as I can tell, absolutely nothing for all eternity. I have to kill the boinc process and re-execute in order to upload the processed data. And then it downloads a fresh package - which is exactly what I am trying to avoid. Am I missing something here?

I want to be able to define an appropriate walltime for a single job and then submit a batch of jobs via torque/moab to my cluster (just like you used to be able to do with S@H classic). Is this a preference issue, or was boinc somehow not designed to do something like this?
ID: 8091 · Report as offensive
Keck_Komputers
Avatar

Send message
Joined: 29 Aug 05
Posts: 304
United States
Message 8092 - Posted: 9 Feb 2007, 8:59:29 UTC

Both are leftover test flags and generally should not be used. Return results immediately has been permanently disabled due the the excessive load it puts on the servers. I am not sure of the status of -exit_when_idle. However if the client can get more work it will not be idle and will not exit.
BOINC WIKI

BOINCing since 2002/12/8
ID: 8092 · Report as offensive
brentwg

Send message
Joined: 9 Feb 07
Posts: 6
Canada
Message 8095 - Posted: 9 Feb 2007, 10:46:39 UTC - in response to Message 8092.  

Thanks very much for the response. I am glad that you made this very clear.

So, I guess that my next question is how do I tell the client to process exactly 1 data package, ship back the results, and then terminate?

Unless, of course, people are using some other kind of method to batch submit boinc jobs to large HPC clusters... Um, is this the case?
ID: 8095 · Report as offensive
ProfileKSMarksPsych
Avatar

Send message
Joined: 30 Oct 05
Posts: 1239
United States
Message 8097 - Posted: 9 Feb 2007, 11:47:21 UTC
Last modified: 9 Feb 2007, 12:12:55 UTC

Are you looking to use BOINC locally to manage your own data analysis?

(Sorry if it's a dumb question...)


If that's the case, probably the BOINC_projects mailing list would be the best place to ask.


If not, then I don't have an answer for you.
Kathryn :o)
ID: 8097 · Report as offensive
Nicolas

Send message
Joined: 19 Jan 07
Posts: 1179
Argentina
Message 8114 - Posted: 9 Feb 2007, 15:51:16 UTC

I don't understand why you would want to make BOINC terminate after a single workunit. Just leave it there and it will see there isn't any work available. Otherwise, when you want to release more work (I'm assuming you're talking about your own project), you would have to start BOINC on all machines again!

If what you want is to avoid clients to get more than one workunit, there are server settings for that.
ID: 8114 · Report as offensive
brentwg

Send message
Joined: 9 Feb 07
Posts: 6
Canada
Message 8118 - Posted: 9 Feb 2007, 19:48:41 UTC - in response to Message 8114.  

I don't understand why you would want to make BOINC terminate after a single workunit.


Because of the very nature of how HPC clusters work (ie. you share 1000s of CPUs with thousands of other researchers, all waiting to run next in the queue), of course I want it to terminate after a single workunit is processed. I have to get out the way so that other people can run their jobs. That's how scheduling and resource allocation software like Torque and MOAB work.

You simply need to be able to predict how long it takes for a single work unit to process, then you reserve a CPU for approximately this much time. It's as simple as that. I had no problem whatsoever doing this with the classic S@H client. But it seems like maybe this is an impossible task with the BOINC version.

Or maybe I'll just find another way to do this...
ID: 8118 · Report as offensive
Nicolas

Send message
Joined: 19 Jan 07
Posts: 1179
Argentina
Message 8119 - Posted: 9 Feb 2007, 19:53:47 UTC

If the BOINC core client keeps running, it won't be using CPU. It will just be there waiting for work.

Change BOINC sourcecode if you want it different.
ID: 8119 · Report as offensive
brentwg

Send message
Joined: 9 Feb 07
Posts: 6
Canada
Message 8120 - Posted: 9 Feb 2007, 19:54:26 UTC - in response to Message 8097.  

Are you looking to use BOINC locally to manage your own data analysis?

(Sorry if it's a dumb question...)


Not a dumb question at all. I appreciate your response.

I am not actually using BOINC to manage my own data analysis. Rather, I am trying to figure out a method for batch scheduling multiple serial jobs on a HPC linux cluster via TORQUE/MOAB scheduling software.
ID: 8120 · Report as offensive
brentwg

Send message
Joined: 9 Feb 07
Posts: 6
Canada
Message 8121 - Posted: 9 Feb 2007, 20:01:20 UTC - in response to Message 8119.  

If the BOINC core client keeps running, it won't be using CPU. It will just be there waiting for work.

Change BOINC sourcecode if you want it different.


No offense, but I think that you are completely missing the point. It doesn't matter to TORQUE/MOAB whether or not I am actually using the CPU. It can't schedule anyone else's job to this node so long as I have reserved it. This is why it's most efficient for me to get in, do my work, upload the results, and then get out of the way, and then wait my turn again for some other node to become available, and then start a brand new process all over again. This is how you share resources in a HPC cluster.

I've searched Google for days now and I am just surprised that nobody has a solution for using BOINC to process serial jobs.
ID: 8121 · Report as offensive
ProfileKSMarksPsych
Avatar

Send message
Joined: 30 Oct 05
Posts: 1239
United States
Message 8125 - Posted: 9 Feb 2007, 20:36:11 UTC

I won't pretend to understand what you're talking about. But, my best suggestion is to ask on the developers email list (see link in previous post).

The people who usually read these boards are pretty knowledgeable about the client software in "normal" (whatever that is...) cases but when interesting questions like yours are asked, a developer is probably the person to talk to.
Kathryn :o)
ID: 8125 · Report as offensive
brentwg

Send message
Joined: 9 Feb 07
Posts: 6
Canada
Message 8130 - Posted: 9 Feb 2007, 22:04:02 UTC - in response to Message 8125.  

I won't pretend to understand what you're talking about. But, my best suggestion is to ask on the developers email list (see link in previous post).

The people who usually read these boards are pretty knowledgeable about the client software in "normal" (whatever that is...) cases but when interesting questions like yours are asked, a developer is probably the person to talk to.


Thanks for your suggestion. I'll do that.
ID: 8130 · Report as offensive

Message boards : BOINC client : Questions about -exit_when_idle and -return_results_immediately

Copyright © 2025 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.