What are the recommended practices on how to use DDP with wandb?

I often use distributed data laoders in pytorch DDP and often just check the rank and have only rank 0 log. Is that the recommended way to use DDP and wandb?

Thanks!

Here is link to the docs sharing the relevant suggestions. Please let me know incase you have any follow up Qs :slight_smile:

2 Likes