Runtime Architecture
Components
| Component | Description |
|---|---|
| Coordinator | Orchestrates DAG execution and task scheduling |
| Executor Pool | Worker nodes that execute individual tasks |
| State Store | Tracks task state, checkpoints, and metadata |
| Resource Manager | Allocates and monitors compute resources |
| Log Aggregator | Collects and indexes execution logs |
Data Flow
ext DAG Definition → Coordinator → Task Scheduler → Executor Pool → State Store ↓ Log Aggregator
See Also
- Resource Management — Resource allocation
- Scaling — Auto-scaling