Only first sweep for a grid search updated

W&B Help
1

Hello! I am running a sweeps grid search. Unfortunately only the first sweep run is an effective training, all the others have constant value for the evaluation metrics.Here some pictures. I have the feeling that it is not doing the evaluation for the 2,3,4,… model trained. I am using HF Trainer.

image
image1738×540 98.2 KB

How can i plot their result and not lose all the hours of training? Thanks a lot

image
image1920×922 99.4 KB

image
image1920×353 86.7 KB

image
image3580×776 174 KB

image
image1240×936 85.3 KB

image
image1776×944 136 KB

2

Hello @chrode !

Could you send a link to your workspace so I can look at this further? I want to make sure that the correct config for the sweep is being sent to the WandB or look to see if there is an issue with the way that sweeps is logging your results.