dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported3 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- Expand query filter langauge to show the path between two assets
- Emit dynamic partition entries when testing sensors in a branch deployment
- Allow specifying custom base images from public registries for PEX deploys
- Ability to set a default compute kind
- Ability to re-materialize all assets that use a given IO Manager
- Some tagging of assets that can't be loaded by their IO manager
- dagster-dbt - AutoMaterializeRule.skip_on_not_all_parents_updated should allow excluding sources
- Ability to block certain partitions/backfills from executing
- Retrieve the failed assets in a run.
- Add a way for the Dagster Cloud Agent to recover from failure automatically if a code server becomes unavailable
- Docs
- Python not yet supported