# Run sweep on cluster
**URL:** https://community.wandb.ai/t/run-sweep-on-cluster/2629
**Category:** W&B Help
**Tags:** sweeps, beginner-friendly
**Created:** [June 17, 2022, 9:06am UTC](https://community.wandb.ai/t/run-sweep-on-cluster/2629 "2022-06-17T09:06:42Z")
**Posts on this page:** 5
**Page:** 1
### Author:  [@apjansen](https://community.wandb.ai/u/apjansen)
#### Post date: [June 17, 2022, 9:06am UTC](https://community.wandb.ai/t/run-sweep-on-cluster/2629/1 "2022-06-17T09:06:42Z")
I want to run a sweep on a cluster, say I want to use just 1/4th of a node which has 32 cpus (It’s an RNN so cpus are fine and cheaper). One cpu has enough memory to do a run, but of course I want to use all, so ideally I’d want to do 32 training loops in parallel.
How do I get this to work?
---
### Author:  [@mohammadbakir](https://community.wandb.ai/u/mohammadbakir)
#### Post date: [June 21, 2022, 5:47pm UTC](https://community.wandb.ai/t/run-sweep-on-cluster/2629/2 "2022-06-21T17:47:44Z")
Hi @apjansen ,
Thank you for writing in with your question. W&B does support Distributed training, see [here](https://docs.wandb.ai/guides/track/advanced/distributed-training). In addition, we highly recommend using `wandb service` , see [here](https://docs.wandb.ai/guides/track/advanced/distributed-training#wandb-service) , which enhances how W&B handles multiprocessing runs and thus improves reliability in a distributed training setting. Please let me know if you have additional questions.
Regards,
Mohammad
---
### Author:  [@mohammadbakir](https://community.wandb.ai/u/mohammadbakir)
#### Post date: [June 24, 2022, 10:42pm UTC](https://community.wandb.ai/t/run-sweep-on-cluster/2629/3 "2022-06-24T22:42:13Z")
Hi @apjansen , following up on your request regarding distributed training. Is there anything I can help clarify for you from our docs on how to implement your process?
---
### Author:  [@mohammadbakir](https://community.wandb.ai/u/mohammadbakir)
#### Post date: [June 30, 2022, 8:28pm UTC](https://community.wandb.ai/t/run-sweep-on-cluster/2629/4 "2022-06-30T20:28:05Z")
Hi @apjansen since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know!
---
### Author:  [@system](https://community.wandb.ai/u/system)
#### Post date: [August 29, 2022, 8:28pm UTC](https://community.wandb.ai/t/run-sweep-on-cluster/2629/5 "2022-08-29T20:28:57Z")
This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.