Nested Sweep Configuration

It looks like this is supported. It works if you put parameters: between every level. With the previous example it looks like the following:

parameters:
    optimizer:
        parameters:
            learning_rate:
                values: [0.01, 0.001]
            momentum:
                value: 0.9

The original source I referenced (wandb docs) must be indicating that the block below works if it is put under parameters:

optimizer:
    parameters:
        learning_rate:
            values: [0.01, 0.001]
        momentum:
            value: 0.9

I have tested this pattern with deeper hierarchies and it works.

2 Likes