It looks like this is supported. It works if you put parameters:
between every level. With the previous example it looks like the following:
parameters:
optimizer:
parameters:
learning_rate:
values: [0.01, 0.001]
momentum:
value: 0.9
The original source I referenced (wandb docs) must be indicating that the block below works if it is put under parameters:
optimizer:
parameters:
learning_rate:
values: [0.01, 0.001]
momentum:
value: 0.9
I have tested this pattern with deeper hierarchies and it works.