pytorch-lightning
https://github.com/pytorchlightning/pytorch-lightning
Python
The lightweight PyTorch wrapper for high-performance AI research. Scale your models, not the boilerplate.
Triage Issues!
When you volunteer to triage issues, you'll receive an email each day with a link to an open issue that needs help in this project. You'll also receive instructions on how to triage issues.
Triage Docs!
Receive a documented method or class from your favorite GitHub repos in your inbox every day. If you're really pro, receive undocumented methods or classes and supercharge your commit history.
Python not yet supported7 Subscribers
Add a CodeTriage badge to pytorch-lightning
Help out
- Issues
- Use lr setter callback instead of `attr_name` in `LearningRateFinder` and `Tuner`
- Custom batch selection for logging
- Lightning stalls with 2 GPUs on 1 node with SLURM (and apptainer)
- How to incorporate vLLM in Lightning for LLM inference?
- Checkpoint every_n_steps reruns epoch on restore
- Multi-node Training with DDP stuck at "Initialize distributed..." on SLURM cluster
- Turn off hpc checkpoint saving in SLURM environment if trainer.fit(..., ckpt_path="last")
- Log `TensorBoard` histograms
- Expected all tensors to be on the same device... using quantized model with deepspeed zero3
- PyTorch Lightning FSDP takes more memory than PyTorch FSDP
- Docs
- Python not yet supported