_ExperimentWriter overwrites CSV log file after loading checkpoint of training model #20225
Unanswered
f48r1
asked this question in
Lightning Trainer API: Trainer, LightningModule, LightningDataModule
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
CSV logger provided by lightning writes metrics while training a model.
If you resume training via a checkpoint and reuse the CSV logger, unfortunately, the previous logger file is first removed and recreated.
The reference code is here : https://github.com/Lightning-AI/pytorch-lightning/blob/master/src/lightning/fabric/loggers/csv_logs.py#L266
To avoid this inconvenience I have commented on the use of the function here : https://github.com/Lightning-AI/pytorch-lightning/blob/master/src/lightning/fabric/loggers/csv_logs.py#L210
Suggested modifications ?
Beta Was this translation helpful? Give feedback.
All reactions