Changes between Version 1 and Version 2 of JobStage


Ignore:
Timestamp:
Feb 15, 2013, 10:52:21 PM (11 years ago)
Author:
davea
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • JobStage

    v1 v2  
    11= Staging input files =
    22
    3 Input files may be "local" (resident on the project server) or "non-local".
    4 For local files, BOINC fills in the download URL, the file size, and the MD5.
    5 For non-local files, you must supply these yourself in the input template.
    6 You can supply multiple URLs if the file is on multiple data servers.
     3Before using an input file you must "stage" it,
     4i.e. put it where it is accessible via HTTP from volunteer computers.
     5The default way to do this is to store it on your BOINC server,
     6in your project's '''download''' directory hierarchy.
     7To do this, run
     8{{{
     9bin/stage_file [--gzip] [--copy] file_path
     10}}}
     11 --gzip:: send the file in compressed form to 7.0+ clients.  Note: you must also include the '''<gzip/>''' attribute for this file in the job's [JobTemplates input template].
     12 --copy:: copy the file from its current location to the BOINC download directory.  The default is to move it.
    713
    8 == Staging local input files ==
    9 Before submitting a job, you must '''stage''' its local input files using
    10 {{{
    11 bin/stage_file [--gzip] [--copy] file
    12 }}}
    13  --gzip:: send the file in compressed form to 7.0+ clients.  Note: you must also include the '''<gzip/>''' attribute for this file in the job's input template (see above).
    14  --copy:: copy the file from its current location to the BOINC download directory.  The default is to move it.
     14'''stage_file''' also
     15 * checks whether a file of that name already exists in the download hierarchy.
     16   If so, it verifies that the file has the same contents.
     17 * computes and saves the file's MD5 hash.
     18   This eliminates the need to do this each time a job submission refers to the file.
    1519
    1620Note: '''stage_file''' was added to the BOINC trunk on 16 Oct 2012.
    1721If your server code is older than that, use
    1822{{{
    19 cp test_files/12ja04aa `bin/dir_hier_path 12ja04aa`
     23cp file_path `bin/dir_hier_path file_name`
    2024}}}
     25
     26You may also stage input files to servers other than your BOINC server.
     27In that case you must specify the URLs in the [JobTemplates input template].