distributed
https://github.com/dask/distributed
Python
A distributed task scheduler for Dask
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported38 Subscribers
Add a CodeTriage badge to distributed
Help out
- Issues
- Setting a basicConfig before importing distributed changes the scheduler logging level.
- Raise an error in ``scatter`` when ``broadcast`` and AMM are incompatible
- Scheduler deadlocked after stealing failed in `move_task_confirm`
- Failed tasks persist in the Client even if the `Future` object falls out of scope, preventing Future deallocation/task cleanup from the cluster
- Shut down scheduler on unrecoverable exceptions
- `test_task_group_and_prefix_statistics` is very flaky on `mindeps-pandas` CI
- Failure in a task submitted by another task can leave an "erred" task permanently on the cluster
- `test_upload_file_egg` started failing on `mindeps` CI
- P2P Shuffle blows up the task graph with increasing number of partitions
- TimeoutError in distributed.nanny causing gRPC server crash after prolonged analysis
- Docs
- Python not yet supported