lit-llama
https://github.com/lightning-ai/lit-llama
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
not yet supported0 Subscribers
Add a CodeTriage badge to lit-llama
Help out
- Issues
- Question about FlashAttention and KV-cache
- Change variable name
- Why didn't use matrix multiplication in the implememtation of LoRA?
- Training on GPT-4-LLM
- ImportError when trying to use 'Linear8bitLt' from 'lit_llama.quantization'
- Issue with "kv_cache" while using modified generate/lora.py for a list of inputs
- How to migrate the finetune/full.py to a multi-node and multi-gpu environment?
- Resume takes much more GPU RAM?
- How to train 13B version on 8bit with LoRA
- 【solved】use adpater_v2.py fine-tuning llama 13B error
- Docs
- not yet supported