Changes between Version 2 and Version 3 of DataFlow


Ignore:
Timestamp:
Jun 10, 2008, 9:51:54 AM (16 years ago)
Author:
davea
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • DataFlow

    v2 v3  
    66understand the life-cycle of a job:
    77
    8  * The job and its associated input files are generated (typically by a '''work generator''') program.
    9  * One or more instances of the job are created.
    10  * The instances are dispatched to different hosts.
     8 * A '''work generator''' (a program you supply) creates the job and its associated input files.
     9 * BOINC creates one or more instances of the job.
     10 * BOINC dispatches the instances to different hosts.
    1111 * Each host downloads the input files.
    12  * After some queueing delay due to other jobs in progress, it executes the job, then uploads its output files.
    13  * It reports the completed job, possible after an additional delay (whose purpose is to reduce the rate of scheduler requests).
    14  * A '''validator''' program checks the output files, perhaps comparing replicas.
    15  * When a valid instance is found, an '''assimilator''' program handles the results (e.g., by inserting them in a separate database).
     12 * After some queueing delay due to other jobs in progress, the host executes the job, then uploads its output files.
     13 * THe host reports the completed job, possibly after an additional delay (whose purpose is to reduce the rate of scheduler requests).
     14 * A '''validator''' (a program you supply) checks the output files, perhaps comparing replicas.
     15 * When a valid instance is found, an '''assimilator''' (a program you supply) handles the results, e.g., by inserting them in a separate database.
    1616 * When all instances have been completed, a '''file deleter''' deletes the input and output files.
    1717 * A '''DB purge''' program deletes the database entries for the job and job instances.