Changes between Version 2 and Version 3 of FileDeleter


Ignore:
Timestamp:
Apr 17, 2007, 11:33:26 AM (17 years ago)
Author:
davea
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • FileDeleter

    v2 v3  
    44The default file deletion policy is:
    55
    6  * A workunit's input files are deleted when all results are 'over' (reported or timed out)
    7 and the workunit is assimilated.
    8   * A result's output files are deleted after the workunit is assimilated.
    9 The canonical result is handled differently,
    10 since its output files may be needed to validate results that are reported after assimilation;
    11 hence its files are deleted only when all results are over,
    12 and all successful results have been validated.
     6 * A workunit's input files are deleted when all results are 'over' (reported or timed out) and the workunit is assimilated.
     7 * A result's output files are deleted after the workunit is assimilated. The canonical result is handled differently, since its output files may be needed to validate results that are reported after assimilation; hence its files are deleted only when all results are over, and all successful results have been validated.
     8 * periodically remove 'antiques': files that are older than the oldest WU in the database. These files are created when BOINC clients return after the corresponding WU has been deleted from the database.
    139
    14 Command-line options are:
     10Command-line options:
    1511
    16  -preserve_wu_files::   Don't delete input files
    17  -preserve_result_files::       Don't delete output files
    18  -retry_errors::        Retry file deletions that failed previously.
    19  -delete_antiques::     periodically (once per hour) removes any files in the upload/ directory that are older than the oldest WU in the database. These files are created when BOINC clients return work really late after the deadline -- so late that the corresponding WU has been deleted from the database.
     12 -d N:: set debug output level (1/2/3)
     13 -mod M R:: handle only WUs with ID mod M == R
     14 -one_pass:: exit after one pass through DB
     15 -dont_retry_errors::   Don't retry file deletions that failed previously.
     16 -dont_delete_antiques:: Don't delete antiques
     17 -preserve_wu_files::   Update the DB, but don't delete input files
     18 -preserve_result_files:: Update the DB, but don't delete output files
     19 -dont_delete_batches:: Don't delete anything with positive batch number
    2020
    2121In some cases you may not want files to be deleted. There are three ways to accomplish this:
    2222
    23  * Run the file_deleter daemon with the -preserve_wu_files and/or the -preserve_result_files command-line options.
     23 * Use the -preserve_wu_files and/or the -preserve_result_files command-line options.
    2424 * Include <no_delete/> in the [http://boinc.berkeley.edu/files.php <file_info>]
    2525 element for a file in a [http://boinc.berkeley.edu/tools_work.php workunit or result template].
    2626This lets you suppress deletion on a file-by-file basis.
    2727 * Include nodelete in the workunit name.
    28 
    29 You may need to implement your own scheme for deleting files, to avoid overflowing data server storage.