I’m trying to run a bayesian hyperparameter sweep for some inference parameters. I’ve run the sweep initialization command and then started 6 parallel workers on 6 different GPUs. These do one run and then something happened at the second run because, even though the runs are completed and the results saved on the wandb table, the runs start repeating themselves (the third run has the same hyperparameters of the second one and appears to even be the same run on the wandb table, so the total count of runs is always 12).
This is the sweep which I’m happy to share privately if useful.
Thank you very much for the help,