I’m having some issues getting W&B to sync with Tensorboard in PyTorch. According to this issue and the docs, I should initializing SummaryWriter after W&B init possibly using wandb.tensorboard.patch. So far I haven’t been able to get this to work with either torch.utils.tensorboard or tensorboardX …

I don’t get any errors. The code runs and logs to Tensorboard, but nothing gets logged to W&B. Here’s an example run: dazzling-microwave-39: Weights & Biases

Could you share the debug logs for this run? They are in the run directory relative to your script.

debug.log 2021-10-26 07:58:59,137 INFO MainThread:33572 [wandb_setup.py:_flush():71] setting env: {} 2021-10-26 07:58:59,137 INFO MainThread:33572 [wandb_setup.py:_flush():71] setting login settings: {} 2021-10-26 07:58:59,138 INFO MainThread:33572 [wandb_init.py:_log_setup():357] Logging …

debug-internal.log 2021-10-26 07:59:01,207 INFO MainThread:16652 [internal.py:wandb_internal():88] W&B internal server running at pid: 16652, started at: 2021-10-26 07:59:01.207113 2021-10-26 07:59:01,209 INFO WriterThread:16652 [datastore.py:open_for_write():77] open: C:\Users\tim\GitHub\rl_…

@tims457 I am terribly sorry for the delay. Removing the sync_tensorboard=True argument from wandb.init(). If you want more information on using wandb.tensorboard.patch() check out this FAQ

Not sure if you’ve solved this by now. I’ve expereinced something similar. It turned out that wandb wants to create a symbolic link which it can’t simply do on Windows. When I run my script as admin everything worls fine. You could try that as well. It’s not very convenient but works for now.

Pytorch sync_tensorboard help

W&B Help

armanharutyunyan October 26, 2021, 12:59pm 3

Hey there, are you getting an error? If so could you send the stack trace?

Topic		Replies	Views
PyTorch Tensorboard Sync in distributed training experiments W&B Help	5	533	March 1, 2024
With TB SummaryWriter only getting sys logs, no log_scalar shows up W&B Help wandb	4	1005	May 24, 2023
`TypeError: bad argument type for built-in operation` when Syncing TensorBaord log to wandb W&B Help wandb	6	507	January 27, 2024
Sync issue after training W&B Help wandb	6	327	August 20, 2024
Waiting for W&B process to finish... (success) W&B Help	12	4657	March 3, 2023

Pytorch sync_tensorboard help

Related topics