Newly created jobs have an evaluation status of inactive. Once their tasks are ready to be picked up by an evaluator, their status becomes pending. When a job completes successfully, its status becomes evaluated. If it does not complete successfully, the reported evaluation status indicates the reason (failed, timeout, or aborted).

The following diagram illustrates the lifecycle of a job: