What are the recommended practices on how to use DDP with wandb?

I often use distributed data laoders in pytorch DDP and often just check the rank and have only rank 0 log. Is that the recommended way to use DDP and wandb?


Here is link to the docs sharing the relevant suggestions. Please let me know incase you have any follow up Qs :slight_smile: