distributed
https://github.com/dask/distributed
Python
A distributed task scheduler for Dask
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported37 Subscribers
Add a CodeTriage badge to distributed
Help out
- Issues
- Document where local files and spilled data are stored
- Test for balanced scale-up with queuing
- Consistent worker selection for no-deps cases
- Tasks which are obviously root tasks not considered `rootish`
- Queuing does not prevent root task overproduction unless you have enough tasks
- [DNM] Is >=20 worker round-robin even tested?
- Global variable access in register_worker_callbacks
- Pick worker with lowest memory use by percentage, not absolute
- [DNM] `queued`<->`no-worker` transitions
- LocalCluster does not apply worker resources as documented
- Docs
- Python not yet supported