What are the recommended practices on how to use DDP with wandb?

W&B Help
1

I often use distributed data laoders in pytorch DDP and often just check the rank and have only rank 0 log. Is that the recommended way to use DDP and wandb?

Thanks!

2

Here is link to the docs sharing the relevant suggestions. Please let me know incase you have any follow up Qs :slight_smile:

2 Likes
3

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.