PinnedPyTorch Lightning teaminPyTorch Lightning Developer BlogPrevent OOM Errors Training Large Models using Lightning and PyTorch Meta Tensors (Part II)PyTorch Lightning v1.5 introduces experimental support for instantiating LightningModules directly onto meta device with no changes.4 min read·Dec 14, 2021----
PinnedPyTorch Lightning teaminPyTorch Lightning Developer BlogTraining Transformers at Scale With PyTorch LightningIntroducing Lightning Transformers, a new library that seamlessly integrates PyTorch Lightning, HuggingFace Transformers and Hydra6 min read·Apr 21, 2021----
PinnedPyTorch Lightning teaminPyTorch Lightning Developer BlogTorchMetrics — PyTorch Metrics built to scaleMachine learning metrics making evaluations of distributed PyTorch models clean and simple.8 min read·Mar 12, 2021--1--1
PyTorch Lightning teaminPyTorch Lightning Developer BlogExperiment with Billion-Parameter Models Faster using DeepSpeed and Meta TensorsPyTorch’s Meta Tensors can save you huge amounts of time. PyTorch Lightning, together with DeepSpeed and just a single line of code, allows…4 min read·Apr 19, 2022----
PyTorch Lightning teaminPyTorch Lightning Developer BlogActive learning made simple using Flash and BaaLPresenting Bayesian Active Learning (BaaL) with Lightning Flash to train faster with fewer samples.6 min read·Dec 21, 2021--3--3
PyTorch Lightning teaminPyTorch Lightning Developer BlogIntroducing Multiple ModelCheckpoint CallbacksPersist the state of multiple checkpoint callbacks, enabling a more advanced configuration of checkpointing strategies.4 min read·Dec 2, 2021----
PyTorch Lightning teaminPyTorch Lightning Developer BlogLightning CheckpointIO PluginThe Lightning v1.5 introduces a new plugin to enable better extensibility for custom checkpointing implementation.3 min read·Nov 30, 2021----
PyTorch Lightning teaminPyTorch Lightning Developer BlogIntroducing Faster Training with Lightning and Brain Float16Lightning introduces BFloat16 support with a single flag to the Trainer, for faster and stable training in lower precision.3 min read·Nov 24, 2021----
PyTorch Lightning teaminPyTorch Lightning Developer BlogImproved Lightning External LoggersIntroducing Improved Lightning Logger Support for Weight & Biases + Neptune.ai4 min read·Nov 23, 2021----
PyTorch Lightning teaminPyTorchAnnouncing Lightning 1.5Lightning 1.5 introduces Fault-Tolerant Training, LightningLite, Loops Customization, Lightning Tutorials, RichProgressBar10 min read·Nov 22, 2021----