From b70348072598de0297efff9749cf7a754594c685 Mon Sep 17 00:00:00 2001 From: Jirka Date: Tue, 6 Feb 2024 12:16:37 +0100 Subject: [PATCH 1/2] docs: update chlog after `2.1.4` --- src/lightning/app/CHANGELOG.md | 7 +++++++ src/lightning/data/CHANGELOG.md | 30 +++++++++++++++++++++++++++++- 2 files changed, 36 insertions(+), 1 deletion(-) diff --git a/src/lightning/app/CHANGELOG.md b/src/lightning/app/CHANGELOG.md index 99daf11f52322..46e37963fa9e5 100644 --- a/src/lightning/app/CHANGELOG.md +++ b/src/lightning/app/CHANGELOG.md @@ -5,6 +5,13 @@ All notable changes to this project will be documented in this file. The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/). +## [2.1.4] - 2024-01-31 + +### Changed + +- Remove torch distributed for the Dataset Optimizer ([#19182](https://github.com/Lightning-AI/lightning/pull/19182)) + + ## [2.1.3] - 2023-12-21 ### Changed diff --git a/src/lightning/data/CHANGELOG.md b/src/lightning/data/CHANGELOG.md index 9a61d45eb5d59..2d9410ca4895d 100644 --- a/src/lightning/data/CHANGELOG.md +++ b/src/lightning/data/CHANGELOG.md @@ -5,6 +5,34 @@ All notable changes to this project will be documented in this file. The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/). +## [2.1.4] - 2024-01-31 + +### Added + +- Added support for nested folders in map operator ([#19366](https://github.com/Lightning-AI/lightning/pull/19366)) +- Added support for weights to evenly distributed works among workers for map operator ([#19365](https://github.com/Lightning-AI/lightning/pull/19365)) +- Added profiling support to StreamingDataloader ([#19338](https://github.com/Lightning-AI/lightning/pull/19338)) +- Allow any AWS authentication method in studios ([#19336](https://github.com/Lightning-AI/lightning/pull/19336)) +- Added walk operator #19333 +- Added intra node shuffling to accelerate second epoch in StreamingDataset ([#19296](https://github.com/Lightning-AI/lightning/pull/19296)) +- Enabled map over inputs without files input ([#19285](https://github.com/Lightning-AI/lightning/pull/19285)) +- Added Fault Tolerance v2 ([#19196](https://github.com/Lightning-AI/lightning/pull/19196), [#19201](https://github.com/Lightning-AI/lightning/pull/19201)) + +### Changed + +- Switched map operator arguments order ([#19345](https://github.com/Lightning-AI/lightning/pull/19345)) +- Removed torch distributed for the Dataset Optimizer ([#19182](https://github.com/Lightning-AI/lightning/pull/19182)) +- Remove `__len__` from CombinedStreamingDataset ([#19321](https://github.com/Lightning-AI/lightning/pull/19321)) + +### Fixed + +- Fixed race condition in downloader ([#19348](https://github.com/Lightning-AI/lightning/pull/19348)) +- Fixed serializer `io.bytes` image in JPEGSerializer ([#19369](https://github.com/Lightning-AI/lightning/pull/19369)) +- Fixed several bugs found in Studio Data Processor ([#19309](https://github.com/Lightning-AI/lightning/pull/19309)) +- Fixed handling queue errors in streaming dataset reader ([#19167](https://github.com/Lightning-AI/lightning/pull/19167)) +- Fixed chunks eviction in StreamingDataset ([#19214](https://github.com/Lightning-AI/lightning/pull/19214)) + + ## [2.1.3] - 2023-12-21 ### Added @@ -26,7 +54,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/). - Make input dir in `DataProcessor` required ([#18910](https://github.com/Lightning-AI/lightning/pull/18910)) - Remove the `LightningDataset` relying on un-maintained torchdata ([#19019](https://github.com/Lightning-AI/lightning/pull/19019)) -# Fixed +### Fixed - Resolve checkpointing for the Streaming Dataset ([#19123](https://github.com/Lightning-AI/lightning/pull/19123)) - Resolve Item Loader bugs ([#19017](https://github.com/Lightning-AI/lightning/pull/19017)) From be57183e29922dfa51a3eca49bd309804752340f Mon Sep 17 00:00:00 2001 From: Jirka Date: Tue, 6 Feb 2024 13:55:15 +0100 Subject: [PATCH 2/2] not good but was asked to do :( --- src/lightning/data/CHANGELOG.md | 30 +----------------------------- 1 file changed, 1 insertion(+), 29 deletions(-) diff --git a/src/lightning/data/CHANGELOG.md b/src/lightning/data/CHANGELOG.md index 2d9410ca4895d..9a61d45eb5d59 100644 --- a/src/lightning/data/CHANGELOG.md +++ b/src/lightning/data/CHANGELOG.md @@ -5,34 +5,6 @@ All notable changes to this project will be documented in this file. The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/). -## [2.1.4] - 2024-01-31 - -### Added - -- Added support for nested folders in map operator ([#19366](https://github.com/Lightning-AI/lightning/pull/19366)) -- Added support for weights to evenly distributed works among workers for map operator ([#19365](https://github.com/Lightning-AI/lightning/pull/19365)) -- Added profiling support to StreamingDataloader ([#19338](https://github.com/Lightning-AI/lightning/pull/19338)) -- Allow any AWS authentication method in studios ([#19336](https://github.com/Lightning-AI/lightning/pull/19336)) -- Added walk operator #19333 -- Added intra node shuffling to accelerate second epoch in StreamingDataset ([#19296](https://github.com/Lightning-AI/lightning/pull/19296)) -- Enabled map over inputs without files input ([#19285](https://github.com/Lightning-AI/lightning/pull/19285)) -- Added Fault Tolerance v2 ([#19196](https://github.com/Lightning-AI/lightning/pull/19196), [#19201](https://github.com/Lightning-AI/lightning/pull/19201)) - -### Changed - -- Switched map operator arguments order ([#19345](https://github.com/Lightning-AI/lightning/pull/19345)) -- Removed torch distributed for the Dataset Optimizer ([#19182](https://github.com/Lightning-AI/lightning/pull/19182)) -- Remove `__len__` from CombinedStreamingDataset ([#19321](https://github.com/Lightning-AI/lightning/pull/19321)) - -### Fixed - -- Fixed race condition in downloader ([#19348](https://github.com/Lightning-AI/lightning/pull/19348)) -- Fixed serializer `io.bytes` image in JPEGSerializer ([#19369](https://github.com/Lightning-AI/lightning/pull/19369)) -- Fixed several bugs found in Studio Data Processor ([#19309](https://github.com/Lightning-AI/lightning/pull/19309)) -- Fixed handling queue errors in streaming dataset reader ([#19167](https://github.com/Lightning-AI/lightning/pull/19167)) -- Fixed chunks eviction in StreamingDataset ([#19214](https://github.com/Lightning-AI/lightning/pull/19214)) - - ## [2.1.3] - 2023-12-21 ### Added @@ -54,7 +26,7 @@ The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/). - Make input dir in `DataProcessor` required ([#18910](https://github.com/Lightning-AI/lightning/pull/18910)) - Remove the `LightningDataset` relying on un-maintained torchdata ([#19019](https://github.com/Lightning-AI/lightning/pull/19019)) -### Fixed +# Fixed - Resolve checkpointing for the Streaming Dataset ([#19123](https://github.com/Lightning-AI/lightning/pull/19123)) - Resolve Item Loader bugs ([#19017](https://github.com/Lightning-AI/lightning/pull/19017))