Delete part of logs

W&B Help
1

Hi,
Is there a way to delete part of the logs?
My context: the training had diverged from som point (see below), and I want to resume from “before bad” and remove the diverged part from logs. And removing diverged part is to allow comparison with other runs, because now outliers dominate and cannot be filtered out, because with 1000 steps diverged they are not outliers anymore
image

2

Hi @dmytro-hover , thank you for reaching out with your question.

We are rolling out the Rewind feature, that allow to modify the history of a Run from a specific step - you can find further info on our documentation here.

This requires wandb >= 0.17.1 and also is being rolled out in phases to different teams and projects to the Multi Tenant Cloud.

If you don’t mind sharing the name of the project you are looking at, I can check if this is enabled for this project.

3

Hi @dmytro-hover , I wanted to follow up on this request. Please let us know if we can be of further assistance

4

Hi,
Sorry, I was a bit sick. The project is Weights & Biases. Please, check if that feature flag is on

5

Hi @dmytro-hover , thank you for sharing and hope you are feeling better. Currently is not enabled on this project - I am checking internally for a timeline for this to be enabled and will keep you posted.

6

Hi @dmytro-hover, Rewind is now enabled for you project - see docs here on how to use this for your use case.

I will be marking this as resolved, please don’t hesitate to reach out if you have any further questions.

7

Cool, thank you, that’s much appreciated!

1 Like