Structuring Code For Interruptible session

W&B Help
1

Looking to scale up my project to some cloud service, and it seems the prices are much cheaper for interruptible sessions.

How do I use W&B for an experiment (either a single train run or a HP sweep) in such an environment? Is there anything fancy needed to re-start a sweep where it left off?

I’m using Pytorch Lightning for the model/trainer and hoping to use AWS/Grid.ai/other cloud service to scale up.

Thanks,
Max

2 Likes
2

Hi Max!

Here’s some documentation on running wandb sweeps on preemptible instances.

I know I sent this on the PyTorch Lightning forum, but hopefully this’ll help people who find this post.

I’d love to hear how you get on experimenting with this and PyTorch Lightning :zap:

3 Likes
3

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.