ratchet
https://github.com/huggingface/ratchet
Rust
A cross-platform browser ML framework.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Rust not yet supported1 Subscribers
Add a CodeTriage badge to ratchet
Help out
- Issues
- Vectorized KV-Cache
- [Feature Request] Allow interrupting the text generation
- Conv!
- Tests migration to tch
- Operator Fusion
- [Feature Request] Cache also the `tokenizer.json` when running the model
- User Reporting Util
- Minimum number of copies from `Uint8Array` to `wgpu::Buffer`
- Reduce dependencies! 🗡️
- Add `CustomOp` functionality
- Docs
- Rust not yet supported