Hi, I have a program which needs multiple GPUs to run at the same time, currently I use DDP to launch the program. I wonder how can I do the sweeping , the program will still be launched in DDP mode (using all GPUs) at each trial. Thanks!
Best
Hi Weipeng,
I am happy to help you with this. Are you using PyTorch or PyTorch lightning?
Hi Weipeng,
I am following up on your recent issue with DDP. If you require further assistance please let do reach out again.
Regards,
Mohammad
Hi Weipeng,
As we have not heard back from you, I’ll be closing this ticket. But please do reach out again at anytime if you need any assistance.
Regards,
Mohammad
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.