Skip to main content

Creating ETL Jobs

Via CLI​

ash proai job create my-job --pipeline my-pipeline --env production

Via YAML​

# jobs/my-job.yml
job: my-job
pipeline: my-pipeline
description: "Daily user analytics ETL"
schedule: "0 2 * * *" # 2 AM daily
environment: production
config:
retries: 3
timeout: 3600
parallelism: 4
`

## Via Designer

1. Open the pipeline in the Designer
2. Click **Create Job** in the top toolbar
3. Configure schedule, environment, and resources
4. Click **Save**

## Job Configuration Options

| Option | Description | Default |
|--------|-------------|---------|
|
etries | Number of retry attempts | 3 |
| imeout | Maximum execution time (seconds) | 3600 |
| parallelism | Number of concurrent tasks | 4 |
| memory_limit | Memory limit per task | 4GB |

## See Also

- [Scheduling](/docs/etl-jobs/scheduling) — Configure schedules
- [Error Handling](/docs/etl-jobs/error-handling) — Error management