PinnedPublished inPyTorch Lightning Developer BlogPrevent OOM Errors Training Large Models using Lightning and PyTorch Meta Tensors (Part II)PyTorch Lightning v1.5 introduces experimental support for instantiating LightningModules directly onto meta device with no changes.Dec 14, 2021Dec 14, 2021
PinnedPublished inPyTorch Lightning Developer BlogTraining Transformers at Scale With PyTorch LightningIntroducing Lightning Transformers, a new library that seamlessly integrates PyTorch Lightning, HuggingFace Transformers and HydraApr 21, 2021Apr 21, 2021
PinnedPublished inPyTorch Lightning Developer BlogTorchMetrics — PyTorch Metrics built to scaleMachine learning metrics making evaluations of distributed PyTorch models clean and simple.Mar 12, 20211Mar 12, 20211
Published inPyTorch Lightning Developer BlogExperiment with Billion-Parameter Models Faster using DeepSpeed and Meta TensorsPyTorch’s Meta Tensors can save you huge amounts of time. PyTorch Lightning, together with DeepSpeed and just a single line of code, allows…Apr 19, 2022Apr 19, 2022
Published inPyTorch Lightning Developer BlogActive learning made simple using Flash and BaaLPresenting Bayesian Active Learning (BaaL) with Lightning Flash to train faster with fewer samples.Dec 21, 20213Dec 21, 20213
Published inPyTorch Lightning Developer BlogIntroducing Multiple ModelCheckpoint CallbacksPersist the state of multiple checkpoint callbacks, enabling a more advanced configuration of checkpointing strategies.Dec 2, 2021Dec 2, 2021
Published inPyTorch Lightning Developer BlogLightning CheckpointIO PluginThe Lightning v1.5 introduces a new plugin to enable better extensibility for custom checkpointing implementation.Nov 30, 2021Nov 30, 2021
Published inPyTorch Lightning Developer BlogIntroducing Faster Training with Lightning and Brain Float16Lightning introduces BFloat16 support with a single flag to the Trainer, for faster and stable training in lower precision.Nov 24, 2021Nov 24, 2021
Published inPyTorch Lightning Developer BlogImproved Lightning External LoggersIntroducing Improved Lightning Logger Support for Weight & Biases + Neptune.aiNov 23, 2021Nov 23, 2021
Published inPyTorchAnnouncing Lightning 1.5Lightning 1.5 introduces Fault-Tolerant Training, LightningLite, Loops Customization, Lightning Tutorials, RichProgressBarNov 22, 2021Nov 22, 2021
