dagster

Orchestrate, schedule, and monitor data pipelines and assets.

pipmacoslinuxwindows

Try with needOr install directly

About

Dagster is an orchestration platform for the development, production, and observation of data assets.

dagsterdagit

start the web interface for managing pipelines$ dagit

run a job or pipeline from the command line$ dagster job execute -f my_pipeline.py -j my_job

list all available jobs in a project$ dagster job list -f my_pipeline.py

validate a pipeline definition for errors$ dagster pipeline validate -f my_pipeline.py

launch a scheduled pipeline run$ dagster schedule launch -n my_schedule