# Has anyone used wandb sweeps and torch.distributed before?
**URL:** https://community.wandb.ai/t/has-anyone-used-wandb-sweeps-and-torch-distributed-before/2184
**Category:** W&B Help
**Created:** [April 4, 2022, 1:04am UTC](https://community.wandb.ai/t/has-anyone-used-wandb-sweeps-and-torch-distributed-before/2184 "2022-04-04T01:04:36Z")
**Posts on this page:** 3
**Page:** 1
### Author:  [@kevin-miao](https://community.wandb.ai/u/kevin-miao)
#### Post date: [April 4, 2022, 1:04am UTC](https://community.wandb.ai/t/has-anyone-used-wandb-sweeps-and-torch-distributed-before/2184/1 "2022-04-04T01:04:36Z")
Hi! My first time posting here. One of my code bases uses torch.distributed for distributed training over different GPUs. Currently, I am writing .sh scripts to deal with hyperparameter sweeping. I was wondering if anyone had experience with using wandb sweep functionality to launch sweeps for torch.distributed training scripts.
---
### Author:  [@ramit\_goolry](https://community.wandb.ai/u/ramit_goolry)
#### Post date: [April 4, 2022, 10:12pm UTC](https://community.wandb.ai/t/has-anyone-used-wandb-sweeps-and-torch-distributed-before/2184/2 "2022-04-04T22:12:03Z")
Hi @kevin-miao,
We do not have an example for torch.distributed with Sweeps, but an example for integrating `wandb` with torch.distributed can be found [here](https://github.com/wandb/examples/tree/master/examples/pytorch/pytorch-ddp). It should be fairly straightforward to extend this example to a sweep.
Please let me know if you face issues with this.
Thanks,
Ramit
---
### Author:  [@system](https://community.wandb.ai/u/system)
#### Post date: [June 3, 2022, 10:12pm UTC](https://community.wandb.ai/t/has-anyone-used-wandb-sweeps-and-torch-distributed-before/2184/3 "2022-06-03T22:12:59Z")
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.