I have read the following post: Group by multiple variables in charts - W&B Help - W&B Community (wandb.ai)
But this solution does not work for the “Parallel coordinates” or “Run comparer” to find optimal hyperparameters where multiple seeds are used for each experiment.
For me, I setup it up like such:
But for the “Parallel coordinates” it averages the groups of “step_size” & “features”:
For the “Run comparer” it does the same, it averages the “step_size” and “features”.
How do I get the same separate runs as in the plots shown in the first image for the “Parallel coordinates” & “Run comparer”?
Hi @capsar-meijer thank you for reporting this issue. I have logged this bug for both plots, and I have added you to the internal ticket so that we can share any updates with you once it’s fixed. I am wondering if you could try to group only by one field (eg. only step_size) if you would see a different behavior? also, what about removing the features from the PC plot (to check if the issue is related to the values being a list)?
Thank you for picking this up.
Hi @capsar-meijer thanks a lot for the additional details. I have updated the internal bug report to include this information too. We will keep you posted here once this functionality works for grouped runs.
Hi @thanos-wandb, thank you for raising the bug with the team.
After continuing analysis, I figured that another place where the grouping is lacking is in displaying media, for me specifically its displaying matplotlib figures.
I am logging a matplotlib figure that displays how well a model is able to forecast a time-series. Now I am trying out multiple hyperparameters and would like to see the figures that are related (in same group) also close by in the Media window. Currently it is just displaying individual runs without any indication of which group they belong too, making it difficult to analyse them compared to the 100+ other images.
Thank you for the additional request here, @capsar-meijer . That’s correct we don’t support grouping in logged matplotlib figures, but I’ve logged this feature reques now with the team.