Out-of-BOINC tasks downloading and adding then files to BOINC.

Message boards : Questions and problems : Out-of-BOINC tasks downloading and adding then files to BOINC.
Message board moderation

To post messages, you must log in.

AuthorMessage
AlexNG

Send message
Joined: 26 Jan 10
Posts: 1
Belarus
Message 30689 - Posted: 26 Jan 2010, 8:25:01 UTC

I have heavy INet restrictions at office (can't download files larger than 2Mb and big 400-500Mb traffic of multiple small files will also be punished) while I would like to participate in distributed computing. I see that many projects like climateprediction.net, rosetta etc have large files (3-20Mb+) in downloads required, and total task download traffic can consume these 400-500Mb.
How can I download task files separately and feed them to BOINC so it will start to do the task ? What about output data size estimation, will it be of same size so require separate uploading procedure again ?
Can you advise me API documentation on tasks requesting ?
I hope such out-of-BOINC download can/will be implemented.
ID: 30689 · Report as offensive
Les Bayliss
Help desk expert

Send message
Joined: 25 Nov 05
Posts: 1654
Australia
Message 30692 - Posted: 26 Jan 2010, 9:01:31 UTC - in response to Message 30689.  

Climateprediction has several types of model, all with different sizes of files, and usually with several files to download.

The model with the shortest runtime, also has the largest download/upload, something that was predicted years ago when people complained about the long models then available.

For this short model, the downloads consist of a basic file of about 80 Megs, plus a file of 28 Megs for each different year to be modelled, plus some smaller files.
For the upload, there are 3 files: 25 Megs, 20 Megs, and 212 K.

This project isn't suitable for people with limited bandwidth, or file size restrictions.

ID: 30692 · Report as offensive
BobCat13

Send message
Joined: 6 Dec 06
Posts: 118
United States
Message 30694 - Posted: 26 Jan 2010, 16:40:10 UTC - in response to Message 30689.  

You can try using the following chart to choose projects that don't require much data transfer. Note: chart was last updated over 6 months ago.

http://www.boinc.cz/img/BOINC_Projects_table.png
ID: 30694 · Report as offensive
Richard Haselgrove
Volunteer tester
Help desk expert

Send message
Joined: 5 Oct 06
Posts: 5082
United Kingdom
Message 30695 - Posted: 26 Jan 2010, 17:59:50 UTC

I would nominate AQUA as a notably low-bandwidth project. The biggest hit - well above your limit - would be downloading BOINC itself, but AQUA is an order of magnitude below that. And if you download at the right time, their most demanding application can run for up to 10 days without refueling on a dual core. [Currently available tasks run shorter, and the mix changes frequently as the research develops - keep an eye on their web site].
ID: 30695 · Report as offensive

Message boards : Questions and problems : Out-of-BOINC tasks downloading and adding then files to BOINC.

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.