10 lines
469 B
Markdown
10 lines
469 B
Markdown
# Data Pipeline Orchestrator
|
|
|
|
Automate ETL/ELT workflows: schedule jobs, handle retries, detect schema drift, spin up jobs on demand, and auto-heal failed runs.
|
|
|
|
Agent capabilities to add:
|
|
- Connect to data sources, run transformations, and validate outputs
|
|
- Auto-scale compute for heavy jobs and failover to cheaper instances
|
|
- Send alerts, open issues, or create remediation PRs when data quality breaks
|
|
|
|
Integrations: Airflow, Prefect, dbt, Snowflake, BigQuery, S3. |