Wandb not logging when using ssh

W&B Help
1

Hello!

When I try logging with wandb over ssh, wandb just doesn’t get initiated.
However when I actually fire up the same experiment in person at the workstation, wandb works normal as expected.

I am using wandb logging through Huggingface accelerate, if that information is any helpful.

Can anybody tell me how best to approach this?
THanks!

2

Hi @andrewsong90, thank you for reaching out. Would mind sharing some additional information on the error you are getting on your environment:

  • After remoting via ssh how do you start training and logging via W&B? Do you have a script you invoke?
  • When logging in remotely are you using the same environment as when you are physically at your workstation? If you run the commands wandb --version and wandb login what output you see?
  • Do you get any error from the terminal output that you can share and do you see the ./wandb/run-<date_time>-<runid>/logs folded being created with the debug.log and debug-internal.log?

Thanks!

3

Hi @andrewsong90 , I wanted to follow up on this request. Please let us know if we can be of further assistance or if your issue has been resolved.

4

Hi @andrewsong90 , since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know!