Skip to main content

ETL Jobs Overview

ETL (Extract, Transform, Load) jobs are the core execution units in ProAI. They define how data flows from sources through transformations to destinations.

Job Lifecycle​

ext Created → Configured → Scheduled → Running → Completed/Failed

Key Concepts​

ConceptDescription
JobA configured pipeline ready for execution
RunA single execution attempt of a job
ScheduleA cron or event-based trigger
Run ConfigurationParameters for a specific execution

Creating Jobs​

ash proai job create user-etl --pipeline user-analytics

Monitoring Jobs​

ash proai job list proai job status user-etl proai job logs user-etl --run-id 1234

See Also​