I have several parameters that I intend to grid sweep e.g. batch size, learning rate and optimizer. How can one specify the order in which the parameters are changed?
For instance, suppose I think choice of optimizer will matter least and learning rate will matter most. I’d like to try all possible learning rates on one optimizer before moving on to the next optimizer. How do I do this?