dagster
https://github.com/dagster-io/dagster
Python
An orchestration platform for the development, production, and observation of data assets.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported3 Subscribers
Add a CodeTriage badge to dagster
Help out
- Issues
- Pull dagster-databricks Pipes into it's own library to remove dependency on Spark
- Asset Versioning with partitioned assets does not detect out-of-sync assets after incrementing code_version
- Monitoring ephemeral runs
- Race condition DuckDB in Dagster Essentials
- Support generic type hints
- Draft: [dagster-polars] Pandera integration for DataFrame schema validation :safety_vest:
- reduce assets defs in interior
- Display queue criteria on the run detail page
- in tests, use get_asset_graph instead of get_assets_def
- Change tags on existing operations
- Docs
- Python not yet supported