I encountered an issue where the W&B charts on the dashboard are not updating, even though the logs from the training process are successfully uploaded to the server.
Context:
- I used
wandb.init()in a training process to log metrics. - Additional metrics (e.g.,
'eval/cumulative_success_rate') were logged from another process using the samewandb.init()configuration. - All logs appear to have been successfully uploaded to the server, as verified through the W&B API and history scan.
Problem:
- The W&B charts on the dashboard do not reflect the uploaded data for certain metrics.
- It seems like the uploaded logs are not being rendered into the charts or visualizations properly.