# About hyperparameters sweeping for DDP program

**URL:** <https://community.wandb.ai/t/about-hyperparameters-sweeping-for-ddp-program/2384>\
**Category:** W&B Help\
**Tags:** sweeps\
**Created:** [May 9, 2022, 3:16pm UTC](https://community.wandb.ai/t/about-hyperparameters-sweeping-for-ddp-program/2384 "2022-05-09T15:16:25Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![weipeng](https://avatars.discourse-cdn.com/v4/letter/w/ce7236/32.png) [@weipeng](https://community.wandb.ai/u/weipeng)\
**Post date:** [May 9, 2022, 3:16pm UTC](https://community.wandb.ai/t/about-hyperparameters-sweeping-for-ddp-program/2384/1 "2022-05-09T15:16:25Z")

</div>

Hi, I have a program which needs multiple GPUs to run at the same time, currently I use DDP to launch the program. I wonder how can I do the sweeping , the program will still be launched in DDP mode (using all GPUs) at each trial. Thanks!

Best

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex020/uploads/wandb/original/1X/366b649231631dbab896843020da0056074ac79d.png) [@system](https://community.wandb.ai/u/system)\
**Post date:** [May 10, 2022, 11:06pm UTC](https://community.wandb.ai/t/about-hyperparameters-sweeping-for-ddp-program/2384/2 "2022-05-10T23:06:21Z")

</div>

Hi Weipeng,

I am happy to help you with this. Are you using PyTorch or PyTorch lightning?

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex020/uploads/wandb/original/1X/366b649231631dbab896843020da0056074ac79d.png) [@system](https://community.wandb.ai/u/system)\
**Post date:** [May 16, 2022, 5:05pm UTC](https://community.wandb.ai/t/about-hyperparameters-sweeping-for-ddp-program/2384/3 "2022-05-16T17:05:49Z")

</div>

Hi Weipeng,

I am following up on your recent issue with DDP. If you require further assistance please let do reach out again.

Regards,

Mohammad

---

<div class="post-metadata">

**Author:** ![mohammadbakir](https://avatars.discourse-cdn.com/v4/letter/m/a9a28c/32.png) [@mohammadbakir](https://community.wandb.ai/u/mohammadbakir)\
**Post date:** [May 19, 2022, 8:19pm UTC](https://community.wandb.ai/t/about-hyperparameters-sweeping-for-ddp-program/2384/4 "2022-05-19T20:19:22Z")

</div>

Hi Weipeng,

As we have not heard back from you, I’ll be closing this ticket. But please do reach out again at anytime if you need any assistance.

Regards,

Mohammad

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex020/uploads/wandb/original/1X/366b649231631dbab896843020da0056074ac79d.png) [@system](https://community.wandb.ai/u/system)\
**Post date:** [July 8, 2022, 3:17pm UTC](https://community.wandb.ai/t/about-hyperparameters-sweeping-for-ddp-program/2384/5 "2022-07-08T15:17:18Z")

</div>

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.