distributed
https://github.com/dask/distributed
Python
A distributed task scheduler for Dask
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported37 Subscribers
Add a CodeTriage badge to distributed
Help out
- Issues
- Allow client wait_for_workers to wait for an absolute number of workers
- Future submit()/result() takes very long time to complete with 8MB Python object
- Add worker config options to config system
- `tornado`'s `call_later`, `add_callback`, etc. prevent garbage collection of otherwise released objects
- `DequeHandler` prevents garbage collection of `Worker` instances and others
- Ease memory pressure by deprioritizing root tasks?
- `pytest`'s`LogCaptureHandler` prevents garbage collection of `Worker` instances (and others)
- `test_multi_progressbar_widget_after_close` failed on CI
- Worker event loop performance hampered by GIL/convoy effect
- Provide & use a few more host functions
- Docs
- Python not yet supported