Dagster

What Dagster is

Dagster is an orchestration platform for data and AI pipelines. The site describes a unified control plane covering data orchestration, observability, catalog and lineage, and also mentions an AI analyst for Slack.

It supports ETL and ELT, dbt, Databricks, Python transformations and AI or ML workflows.

What you can do with it

• Orchestrate data and AI pipelines
• See asset lineage and a catalog
• Monitor runs and failures
• Coordinate work across a data team

Who it is for

• Data engineering teams
• ML platform teams
• Analytics engineering teams

What to watch out for

• It orchestrates and monitors; it does not design your data model or business logic
• Reliability depends on task design, data quality and team governance
• It suits teams with continuous pipelines more than one-off scripts
• Self-hosting brings operational responsibility