In RL and ML, we often evaluate the performances of algorithms over various seeds. However, I think this is currently not supported in sweeps. What I want is the sweep to run multiple times the same hyper-parameter values over various seeds and then use an aggregation of the objective values as objective function of the sweep. Of course, I’d like to have control over the seeds, e.g. be able to specify them.
I believe this has been requested already here: Sweeps with multiple seeds for the same config values
I wonder if the utility to aggregate over multiple seeds was added or not in later releases
But closed due to no follow-up from the requester.
Thanks in advance,