evalai
https://github.com/cloud-cv/evalai
Python
:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported1 Subscribers
Add a CodeTriage badge to evalai
Help out
- Issues
- Check challenge phase is corresponding to challenge in update submission API
- Add detailed documentation on auto scaling and what to expect
- Remove Unused Common Errors from Documentation After Transition to Docker Setup.
- [Backend] Add automatic Forum Creation
- Improve docs for code-upload/static code-upload
- Hosting a code-upload based challenge locally
- How to deploy evalai in test and production environments?
- Job names - submission IDs get repeated for code upload submissions
- [Backend] Add is_disabled to Challenge Phase and Challenge Phase Splits and allow new phase and split creation
- [Monitoring] Increment num_processed_submissions on cancellation of submission
- Docs
- Python not yet supported