Skip to content

Commit dfbf0e5

Browse files
thomasthomas
thomas
authored and
thomas
committed
update
1 parent aa99dee commit dfbf0e5

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/lightning/data/README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -252,7 +252,7 @@ for batch in tqdm(train_dataloader):
252252

253253
Lightning Data provides a stateful `StreamingDataLoader`. This simplifies resuming training over large datasets.
254254

255-
Note: The `StreamingDataLoader` is used by [Lit-GPT](https://github.com/Lightning-AI/lit-gpt/blob/main/pretrain/tinyllama.py) to pretrain LLMs.
255+
Note: The `StreamingDataLoader` is used by [Lit-GPT](https://github.com/Lightning-AI/lit-gpt/blob/main/pretrain/tinyllama.py) to pretrain LLMs. The statefulness still works when using a mixture of datasets with the `CombinedStreamingDataset`.
256256

257257
```python
258258
import os

0 commit comments

Comments
 (0)