I am trying to do something as simple as setting the colour and linestyle of different runs in one experiment based on one or more parameters and having a correspondence in the legend, but this doesn’t seem to be straightforward at all.
I recreated my issue in this toy project: https://wandb.ai/tml-dngfra/Test%20MLP?nw=nwuserdngfra but I can’t make it public as under project visibility the only available options are Private or Restricted. How can I make it public?
Thanks @dngfra! Don’t worry, I should be able to view it but not totally sure of what you are trying to do here. Are you trying to modify the color of lines in a Query Panel?
As you can see in the config table, the experiment involves various hyperparameters. I’m trying to understand their interactions and effects on training. For instance, I have different values for weight decay, batch sizes, and number of layers. Currently, when viewing the plots, it’s challenging to understand the effect of a specific parameter since I would have to open and review each run’s configuration separately and remember the colour and linestyle, which isn’t practical. A better approach would be to assign line colors and styles based on certain parameters, with a correspondent updated legend. For example, I would like to set the colors according to the weight decay values of the runs and the line styles based on the batch sizes. Perhaps we could even have separate plots for a third parameter, like the number of layers. I tried to achieve something similar using the query plots, but it does not seem to work. Is there a way to implement this?
Thanks for clarifying this detail while some of the use case you described is addressed by either running a compare panel or parallel coordinates plot the exact functionality you described is not possible.
I have shared screengrabs for using both parameter importance and parallel coordinates plots which we have designed for being able to see the importance of particular parameters and recommend to our users for the type of use case you describe.
I am happy to log a feature request regarding the run colors setting (would you want this by the final value of the summary).
Regarding a more complex/customer approach I wonder if something like our ability to log with plotly/matplotlib here would work for you?
Hi Francesco, since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know!
+1
Highly useful feature.
Maybe a third (say, z-axis) can be added to the line plot to color each line.
It would be even better if we could color each run globally based on some config key.
Thanks.