Skip to main content
The Batch Processing API uses the Jobs Orchestration Service (JOS) to run processing jobs against multiple files. JOS owns the entire lifecycle of the jobs it runs: it validates the configuration, manages job pipelines, handles Kubernetes resource management, monitors the progress of the job, and publishes events. For additional information, see this Batch Processing overview.

Jobs

Create Job

Create a new batch or training job

List Jobs

Retrieve a cursor-paginated list of jobs with optional filters

Get Job

Retrieve details of a specific job by ID

Retry Job

Retry a failed or cancelled job

Pause an ongoing batch job

Resume Job

Resume a paused or interrupted job

Delete Job

Permanently delete a job and its associated data

Cancel Job

Cancel a running or pending job

Get Queue Depths

Retrieve global queue depths grouped by pipeline type

Events

List Job Events

Retrieve a cursor-paginated list of events for a specific job

I/O

List Inputs

Retrieve a cursor-paginated list of inputs for a specific job

List Outputs

Retrieve a cursor-paginated list of outputs for a specific job

List Inputs With Progress

Tracked inputs paired with their latest progress entry

Get Inputs Progress Counts

Per-status counts of tracked inputs for a job

Get Inputs Progress Traces

Bucketed cumulative file and per-kind item counters across the job lifetime

Validate Prospective Inputs

Validate the inputs for a prospective job without creating a job

Progress

List Job Progress

Retrieve cursor-paginated progress entries for a specific job

Registry

List Pipelines

Retrieve a cursor-paginated list of pipelines from the registry

Get Pipeline

Retrieve details of a specific pipeline from the registry

Get Pipeline Schema

Retrieve the configuration schema for a specific pipeline