Simultaneous result uploading?

Message boards : BOINC client : Simultaneous result uploading?
Message board moderation

To post messages, you must log in.

AuthorMessage
ryeterrell

Send message
Joined: 25 Aug 09
Posts: 23
United States
Message 26810 - Posted: 26 Aug 2009, 19:01:32 UTC

Is there some way to make the boinc client upload more than one result at a time? I have rather short (30 second) jobs running on a cluster with 8-processor nodes. While it takes longer to finish each job than it does to upload them, I finish 8 of them at a time, which is faster than my upload time for 8 serial uploads. The result is that my cpus are sitting idle waiting for the uploads to finish. If there were some way to upload more than one result at a time, though, I'd be good to go. Any ideas?

Thanks
ID: 26810 · Report as offensive
Claggy

Send message
Joined: 23 Apr 07
Posts: 1112
United Kingdom
Message 26811 - Posted: 26 Aug 2009, 19:20:59 UTC - in response to Message 26810.  

There are options in cc_config.xml for changing the number of file transfers at once:

How do I configure my client using the cc_config.xml file?

Claggy
ID: 26811 · Report as offensive
MarkJ
Volunteer tester
Help desk expert

Send message
Joined: 5 Mar 08
Posts: 272
Australia
Message 26818 - Posted: 27 Aug 2009, 12:18:34 UTC - in response to Message 26810.  

Is there some way to make the boinc client upload more than one result at a time? I have rather short (30 second) jobs running on a cluster with 8-processor nodes. While it takes longer to finish each job than it does to upload them, I finish 8 of them at a time, which is faster than my upload time for 8 serial uploads. The result is that my cpus are sitting idle waiting for the uploads to finish. If there were some way to upload more than one result at a time, though, I'd be good to go. Any ideas?

Thanks


By default it does 2 file xfers per project with a maximum of 8 transfers at a time. Telling your client to upload more than that tends to overload the project servers, not to mention you'd be competing with yourself for bandwidth on your internet connection.
MarkJ
ID: 26818 · Report as offensive
Nicolas

Send message
Joined: 19 Jan 07
Posts: 1179
Argentina
Message 26950 - Posted: 1 Sep 2009, 0:46:59 UTC - in response to Message 26810.  

Is there some way to make the boinc client upload more than one result at a time? I have rather short (30 second) jobs running on a cluster with 8-processor nodes. While it takes longer to finish each job than it does to upload them, I finish 8 of them at a time, which is faster than my upload time for 8 serial uploads. The result is that my cpus are sitting idle waiting for the uploads to finish. If there were some way to upload more than one result at a time, though, I'd be good to go. Any ideas?

You don't upload results. You upload output files and then report results.

With that said, please clarify what you're talking about.

The client already uploads two files at a time, and tries to report as many results in a single request as possible (by delaying the reports).

What you really need is a cache, though. You should download more than 8 results at a time, so that you can continue crunching while previous files are uploading.
ID: 26950 · Report as offensive

Message boards : BOINC client : Simultaneous result uploading?

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.