Changes between Version 10 and Version 11 of JobSubmission

Timestamp:

Sep 7, 2010, 1:14:14 PM (14 years ago)

Author:

davea

Comment:

--

JobSubmission

@@ -5 +5 @@
 
  1. Write XML 'template files' that describe the job's input and outputs (typically the same template files can be used for many jobs).
- 1. Create the job's input file(s), and put them in the right place (as determined by the file name) in the [DirHierarchy download directory hierarchy].
+ 1. Create and "stage" the job's input file(s) (see below).
  1. Invoke a BOINC function or script that submits the job.
 
@@ -26 +26 @@
     [ <nodelete/> ]
     [ <report_on_rpc/> ]
+    [ <url>...</url> ]
+    [ <md5_cksum>...</md5_cksum> ]
+    [ <nbytes>...</nbytes> ]
 </file_info>
 [ ... other files  ]
@@ -57 +60 @@
   '''<nodelete/>''':: if present, the file is not deleted from the server after job is completed.
   '''<report_on_rpc/>''':: if present, report file in each scheduler request (sticky files)
+  '''<url>, <md5_cksum>, <nbytes>''':: used only for "non-local" input files (see below)
 
  '''<file_ref>''':: describes [BoincFiles#Filereferences the way the file is referenced].
@@ -78 +82 @@
    on a host with insufficient disk space.
 
-Note: The input template is copied into a BLOB column of the workunit table and will substitute filenames, and have download urls, signatures and other elements inserted into your provided template. The total expanded BLOB cannot exceed 65,535 bytes. As a general rule, you should plan to use less then 15 files in your input template. This will allow you some flexibility on making your job names longer, adding more options to your command line, or adding additional download servers as your project grows. If you require more then 15 application and input files, you can achieve this using [FileCompression BOINC file compression] to zip several files into a single file reference for download, and expanding them prior to running on the client machine. You can check to see how large your expanded input templates become by comparing 65,535 with the output the following MySQL statement:[[BR]]
+Note: The input template is copied into a BLOB column of the workunit table and will substitute filenames,
+and have download urls, signatures and other elements inserted into your provided template.
+The total expanded BLOB cannot exceed 65,535 bytes.
+As a general rule, you should plan to use less then 15 files in your input template.
+This will allow you some flexibility on making your job names longer,
+adding more options to your command line, or adding additional download servers as your project grows.
+If you require more then 15 application and input files,
+you can achieve this using [FileCompression BOINC file compression] to zip several files into a single file reference for download,
+and expanding them prior to running on the client machine.
+You can check to see how large your expanded input templates become
+by comparing 65,535 with the output the following MySQL statement:[[BR]]
 {{{select max(length(xml_doc)) from workunit;}}}
 
@@ -145 +159 @@
 == Staging input files ==
 
-Before submitting a job, you must put its input files
+Input files may be "local" (resident on the project server) or "non-local".
+For local files, BOINC fills in the download URL, the file size,
+and the MD5.
+For non-local files, you must supply these yourself in the input template.
+
+=== Staging local input files ===
+Before submitting a job, you must put its local input files
 into the proper place in the [ServerDirs download directory hierarchy].
 BOINC provides both a command-line tool and a function for this.