the lines in my plots seem to be left-truncated after around 20k steps. Is this intended behavior or a problem on the logging side. I use the built-in logging of huggingface trainer and the model resumed after around 20k steps. But the resume starts at the most recent global step, so no values should be overwritten. When trying to export the graph data as csv, the cells are completely empty for those missing values (so not a 0.0, NaN, null or something).
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Resume logging and deleting specific steps | 4 | 929 | January 8, 2024 | |
| Training Plots Disappear once the run is done | 5 | 374 | December 9, 2024 | |
| How to override existing statistics in plot when resuming from a checkpoint? | 3 | 878 | March 25, 2023 | |
| Cannot export all data points | 0 | 990 | May 3, 2022 | |
| Wandb stops uploading data | 19 | 1923 | February 29, 2024 |