Has anyone else run into this error:
ValueError('signal only works in main thread')
I’m running a hyper parameter sweep using PL and Weights and Biases’s framework.
Running on a GPU on Google Colab which causes all launched runs to fail. Running it locally (Mac OS) prompts ‘signal only works in main thread’ to be printed to stdout (which also happens on Colab) but it doesn’t crash.
When I train the model with just PL outside of a W&B sweep, it works fine.
Any ideas? It seems people using Ray with PL have come across this. The hacky solution presented there (
os.environ['SLURM_JOB_NAME'] = 'bash' ) doesn’t work in my case (neither on Mac OS or Colab).