PinnedInPyTorch Lightning Developer BlogbyPyTorch Lightning team·Dec 14, 2021Prevent OOM Errors Training Large Models using Lightning and PyTorch Meta Tensors (Part II)PyTorch Lightning v1.5 introduces experimental support for instantiating LightningModules directly onto meta device with no changes.
PinnedInPyTorch Lightning Developer BlogbyPyTorch Lightning team·Apr 21, 2021Training Transformers at Scale With PyTorch LightningIntroducing Lightning Transformers, a new library that seamlessly integrates PyTorch Lightning, HuggingFace Transformers and Hydra
PinnedInPyTorch Lightning Developer BlogbyPyTorch Lightning team·Mar 12, 2021TorchMetrics — PyTorch Metrics built to scaleMachine learning metrics making evaluations of distributed PyTorch models clean and simple.A response icon1A response icon1
InPyTorch Lightning Developer BlogbyPyTorch Lightning team·Apr 19, 2022Experiment with Billion-Parameter Models Faster using DeepSpeed and Meta TensorsPyTorch’s Meta Tensors can save you huge amounts of time. PyTorch Lightning, together with DeepSpeed and just a single line of code, allows…
InPyTorch Lightning Developer BlogbyPyTorch Lightning team·Dec 21, 2021Active learning made simple using Flash and BaaLPresenting Bayesian Active Learning (BaaL) with Lightning Flash to train faster with fewer samples.A response icon4A response icon4
InPyTorch Lightning Developer BlogbyPyTorch Lightning team·Dec 2, 2021Introducing Multiple ModelCheckpoint CallbacksPersist the state of multiple checkpoint callbacks, enabling a more advanced configuration of checkpointing strategies.
InPyTorch Lightning Developer BlogbyPyTorch Lightning team·Nov 30, 2021Lightning CheckpointIO PluginThe Lightning v1.5 introduces a new plugin to enable better extensibility for custom checkpointing implementation.
InPyTorch Lightning Developer BlogbyPyTorch Lightning team·Nov 24, 2021Introducing Faster Training with Lightning and Brain Float16Lightning introduces BFloat16 support with a single flag to the Trainer, for faster and stable training in lower precision.
InPyTorch Lightning Developer BlogbyPyTorch Lightning team·Nov 23, 2021Improved Lightning External LoggersIntroducing Improved Lightning Logger Support for Weight & Biases + Neptune.ai
InPyTorchbyPyTorch Lightning team·Nov 22, 2021Announcing Lightning 1.5Lightning 1.5 introduces Fault-Tolerant Training, LightningLite, Loops Customization, Lightning Tutorials, RichProgressBar
