lit-llama
https://github.com/lightning-ai/lit-llama
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
not yet supported0 Subscribers
Add a CodeTriage badge to lit-llama
Help out
- Issues
- Can not finetune, OOM on v100 with batchsize 6
- Conversion to ggml format
- Switch between LoRA adapters?
- Inquiry about lit-llama's training speed
- Can training with the scripts here increase the token limit beyond 2k?
- Improve 8-bit quantization support
- Is there an interactive mode?
- Model compilation support
- H100 Transformer Engine implementation
- Docs
- not yet supported