Reuse same file in multiple work units

Message boards : Server programs : Reuse same file in multiple work units
Message board moderation

To post messages, you must log in.

AuthorMessage
Seth

Send message
Joined: 19 Nov 16
Posts: 63
Australia
Message 74635 - Posted: 7 Dec 2016, 2:15:20 UTC

HI,
In my project my work units consist of two files.

One file is reused, up to several hundred times, in conjunction with a second input file which is unique.

What I have discovered is that the file that needs to be reused is deleted from the staging area, possibly sometime after the first work unit requiring this file has completed. This results in errors when a new client attaches and attempts to download a WU that requires the common file. I get errors when trying to HTTP download the common file as it's no longer in the staging area.

How is it possible to ensure the common file stays in the staging area until all work units that use that common file are complete?

I'm think this can only be achieved by staging the files on a separate external web server or perhaps S3 bucket?

Cheers
Seth
ID: 74635 · Report as offensive
BobCat13

Send message
Joined: 6 Dec 06
Posts: 118
United States
Message 74636 - Posted: 7 Dec 2016, 3:12:01 UTC - in response to Message 74635.  

http://boinc.berkeley.edu/trac/wiki/JobTemplates

The <no_delete/> option may be what you are looking for.
ID: 74636 · Report as offensive
Seth

Send message
Joined: 19 Nov 16
Posts: 63
Australia
Message 74677 - Posted: 8 Dec 2016, 7:55:53 UTC - in response to Message 74636.  

Great thanks!
ID: 74677 · Report as offensive

Message boards : Server programs : Reuse same file in multiple work units

Copyright © 2024 University of California.
Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.2 or any later version published by the Free Software Foundation.