Lightning-AI/pytorch-lightning 2.1.3

Minor patch release v2.1.3

on GitHub

App

Changed

• Lightning App: Use the batch get endpoint (#19180)
• Drop starsessions from App's requirements (#18470)
• Optimize loading time for chunks to be there (#19109)

Data

Added

• Add fault tolerance StreamingDataset (#19052)
• Add numpy support for the StreamingDataset (#19050)
• Add fault tolerance for the StreamingDataset (#19049)
• Add direct s3 support to the StreamingDataset (#19044)
• Add disk usage check before downloading files (#19041)

Changed

• Cleanup chunks right away if the dataset doesn't fit within the cache in StreamingDataset (#19168)
• StreamingDataset improve deletion strategy (#19118)
• Improve StreamingDataset Speed (#19114)
• Remove time in the Data Processor progress bar (#19108)
• Optimize loading time for chunks to be there (#19109)
• Resolve path for StreamingDataset (#19094)
• Make input dir in DataProcessor required (#18910)
• Remove the LightningDataset relying on un-maintained torchdata (#19019)

Fixed

• Resolve checkpointing for the Streaming Dataset (#19123)
• Resolve Item Loader bugs (#19017)

Fabric

Fixed

• Avoid moving the model to device if move_to_device=False is passed (#19152)
• Fixed broadcast at initialization in MPIEnvironment (#19074)

PyTorch

Changed

• LightningCLI no longer allows setting a normal class instance as default. A lazy_instance can be used instead (#18822)

Fixed

• Fixed checks for local file protocol due to fsspec changes in 2023.10.0 (#19023)
• Fixed automatic detection of 'last.ckpt' files to respect the extension when filtering (#17072)
• Fixed an issue where setting CHECKPOINT_JOIN_CHAR or CHECKPOINT_EQUALS_CHAR would only work on the ModelCheckpoint class but not on an instance (#19054)
• Fixed ModelCheckpoint not expanding the dirpath if it has the ~ (home) prefix (#19058)
• Fixed handling checkpoint dirpath suffix in NeptuneLogger (#18863)
• Fixed an edge case where ModelCheckpoint would alternate between versioned and unversioned filename (#19064)
• Fixed broadcast at initialization in MPIEnvironment (#19074)
• Fixed the tensor conversion in self.log to respect the default dtype (#19046)

Full Changelog: 2.1.2...2.1.3

Contributors

@AleksanderWWW, @awaelchli, @Borda, @carmocca, @dependabot[bot], @mauvilsa, @MF-FOOM, @tchaton, @yassersouri

If we forgot someone due to not matching commit email with GitHub account, let us know :]