My code worked the last time I used it, but now I am getting this errors:
Epoch 59: 42%|▍| 66/157 [00:00<00:00, 93.47it/s, v_num=7p7h, train_loss=0.100, train_absolute_error_v=0.375, val_loss=0.101, val_absolute_error_v=0Thread SenderThread:
Traceback (most recent call last):
File “C:\Users\wiwec\AppData\Local\pypoetry\Cache\virtualenvs\thesisproject-QoUIeoIA-py3.11\Lib\site-packages\wandb\sdk\internal\internal_util.py”, line 48, in run
self._run()
File “C:\Users\wiwec\AppData\Local\pypoetry\Cache\virtualenvs\thesisproject-QoUIeoIA-py3.11\Lib\site-packages\wandb\sdk\internal\internal_util.py”, line 99, in _run
self._process(record)
File “C:\Users\wiwec\AppData\Local\pypoetry\Cache\virtualenvs\thesisproject-QoUIeoIA-py3.11\Lib\site-packages\wandb\sdk\internal\internal.py”, line 327, in _process
self._sm.send(record)
File “C:\Users\wiwec\AppData\Local\pypoetry\Cache\virtualenvs\thesisproject-QoUIeoIA-py3.11\Lib\site-packages\wandb\sdk\internal\sender.py”, line 386, in send
send_handler(record)
File “C:\Users\wiwec\AppData\Local\pypoetry\Cache\virtualenvs\thesisproject-QoUIeoIA-py3.11\Lib\site-packages\wandb\sdk\internal\sender.py”, line 408, in send_request
send_handler(record)
File “C:\Users\wiwec\AppData\Local\pypoetry\Cache\virtualenvs\thesisproject-QoUIeoIA-py3.11\Lib\site-packages\wandb\sdk\internal\sender.py”, line 1212, in send_request_summary_record
self._update_summary_record(record.request.summary_record.summary)
File “C:\Users\wiwec\AppData\Local\pypoetry\Cache\virtualenvs\thesisproject-QoUIeoIA-py3.11\Lib\site-packages\wandb\sdk\internal\sender.py”, line 1206, in _update_summary_record
self._update_summary()
File “C:\Users\wiwec\AppData\Local\pypoetry\Cache\virtualenvs\thesisproject-QoUIeoIA-py3.11\Lib\site-packages\wandb\sdk\internal\sender.py”, line 1226, in _update_summary
with open(summary_path, “w”) as f:
^^^^^^^^^^^^^^^^^^^^^^^
OSError: [Errno 22] Invalid argument: ‘wandbresults\leaky_relu-0.01_d3_adamw_s1_20240917-230538\wandb\run-20240917_230542-bwc27p7h\files\wandb-summary.json’
Epoch 59: 100%|█| 157/157 [00:01<00:00, 87.56it/s, v_num=7p7h, train_loss=0.122, train_absolute_error_v=0.438, val_loss=0.0911, val_absolute_error_vwandb: ERROR Internal wandb error: file data was not synced
I am using wandb version 0.17.1 (also tried with upgraded one but also not wokring)
and pytorch-lightning version = “2.2.5”. Also tried to move files directionary into not onedrive but same problem occurs. Any ideas what I can do now?