Wandb: Network error (TransientError), entering retry loop

wandb-upload_0:1555 [internal_api.py:upload_file():2496] upload_file exception https://storage.googleapis.com/wandb-production.appspot.com/snorfyang/Kaggle-CommonLit/7e8blq9g/wandb-metadata.json?Expires=1693107571&GoogleAccessId=gorilla-files-url-signer-man%40wandb-production.iam.gserviceaccount.com&Signature=QF%2F%2FjlqLbj3XScsu5TbHbVuoxamn2frEfHNqWym6vsauLyjlXTe2vjrKa2Jw80mN7%2F%2BDTSOKCHS3AndpSLc3ixehrx%2F6qlgx1UM5N%2FBTPpkR8gAwVW%2BRg3v8bdxO0yN%2BugNT8tfFvVKPbBHLA0zWTYJgHsLm8aW3r8ZMtEOcBXeNTv%2BfK31qvw1FvZ9o5BKd1YPzrVBhU2kQ6BwYru6CFsQyUZoCQhCNfj0tNjQfEkRv0Tss959K8Jz0cerfWz7O5mg1hI91v%2Bf0rQVIaO55PMjcfPUxVFT0NKaal9Mamy34ViLcObJ1sWHr1RDm6KTR5RzJWzsk2sRaE56UvbURmA%3D%3D: (‘Connection aborted.’, ConnectionResetError(104, ‘Connection reset by peer’))

Hi @snorfyang , thank you for writing in. Could you please expand on your request. The upload file exception could happen for variety of reasons including a failed network connection or timing out.

  • What is the size of the file you are uploading
  • How are you logging this file to wandb
  • Could you provide debug logs for the run failing to upload files. These are located in the working directory under wandb//logs folder.

I do not upload any file.
Just use python in the shell and

import wandb
wandb.init()

Then it turns to Wandb: Network error (TransientError), entering retry loop.
Then I tried to use wandb.finish() and it seemed to hang forever.
2023-08-31 13:39:25,984 ERROR wandb-upload_2:1465 [internal_api.py:upload_file():2496] upload_file exception https://storage.googleapis.com/wandb-production.appspot.com/snorfyang/uncategorized/ljxp7uhb/wandb-summary.json?Expires=1693546465&GoogleAccessId=gorilla-files-url-signer-man%40wandb-production.iam.gserviceaccount.com&Signature=HyE%2BQW08NRuzut4ZaXzwBkjDHL5dB3CPDqCxFu%2BagtIiuGRxka792zIuOgjOJx2d5n7Ey4ET9MFXMIo%2BMNeyeksz8cezk%2BcJbcn76H9PJEoTFTrX2zFZFXH7nbWHLZcr02eI%2Bc%2Fz3UjgZEGC%2BzrqgFZtOMrZR%2BBEL%2FaZEDVTKqn4m%2FvWkf%2BHlitfHYWehhwD8RAA7KkHThVWfFFQulG7G7F4dyzqmQ%2Fdx1EHd5q6qUx7ADragnLgWpysaeq%2Bp4xxbewTF%2B98sRsWi3jp7V6JiQzB2eF7irnyBY76UQNBqDJcdn92r39KguHMZ1bzMGhwCVA4Nk52mhypO4iQOsN2Iw%3D%3D: (‘Connection aborted.’, ConnectionResetError(104, ‘Connection reset by peer’))
2023-08-31 13:39:25,984 ERROR wandb-upload_2:1465 [internal_api.py:upload_file():2498] upload_file request headers: {‘User-Agent’: ‘python-requests/2.28.2’, ‘Accept-Encoding’: ‘gzip, deflate, br’, ‘Accept’: ‘/’, ‘Connection’: ‘keep-alive’, ‘Content-Length’: ‘27’}
2023-08-31 13:39:25,984 ERROR wandb-upload_2:1465 [internal_api.py:upload_file():2500] upload_file response body:
2023-08-31 13:39:26,512 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:26,513 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:26,513 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:39:27,513 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:27,513 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:27,710 ERROR wandb-upload_1:1465 [internal_api.py:upload_file():2496] upload_file exception https://storage.googleapis.com/wandb-production.appspot.com/snorfyang/uncategorized/ljxp7uhb/config.yaml?Expires=1693546465&GoogleAccessId=gorilla-files-url-signer-man%40wandb-production.iam.gserviceaccount.com&Signature=dn6W7mZIbKGWs4iwBLFSfxeSODn8NIzdttbNyFtGc6mGiMTBthWs2nH7yMnYAJZUqk5p4DpfrVjkYriE2fA184KwPZT2hb%2BbbSnyvE34e1TwB0iqmzBGdTsoWOUPljnmIsOYZud7dkAIQQBX8GuRcTDtfJ8yUhQ3gozvYVXWYiq855Ufzx%2BfjUuGAsgK7HChbJhyNyaQsPSB14YMdmVdeky7PZTtm5IWzhm9btiuuFBJJc6W%2BPb%2BViyCVDj3Qrpfccem42iaTk%2Fjn5xFgfNA12n9u40%2FtHpjdDZUARZxQEk2tAiDnQeafxyqMYLDGR4BC9hABoGilFNjzQNYSMV%2F9g%3D%3D: (‘Connection aborted.’, ConnectionResetError(104, ‘Connection reset by peer’))
2023-08-31 13:39:27,710 ERROR wandb-upload_1:1465 [internal_api.py:upload_file():2498] upload_file request headers: {‘User-Agent’: ‘python-requests/2.28.2’, ‘Accept-Encoding’: ‘gzip, deflate, br’, ‘Accept’: ‘/’, ‘Connection’: ‘keep-alive’, ‘Content-Length’: ‘315’}
2023-08-31 13:39:27,710 ERROR wandb-upload_1:1465 [internal_api.py:upload_file():2500] upload_file response body:
2023-08-31 13:39:28,513 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:28,514 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:29,514 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:29,515 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:30,515 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:30,515 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:31,515 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:31,516 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:39:31,516 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:32,516 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:32,516 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:33,517 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:33,517 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:34,517 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:34,518 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:35,518 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:35,519 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:36,518 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:36,519 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:36,520 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:39:37,519 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:37,519 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:38,520 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:38,520 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:39,520 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:39,521 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:40,521 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:40,521 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:41,521 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:41,522 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:41,522 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:39:42,522 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:42,522 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:43,523 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:43,523 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:44,523 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:44,524 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:45,524 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:45,525 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:46,524 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:46,525 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:46,525 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:39:47,525 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:47,526 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:48,526 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:48,526 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:49,526 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:49,527 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:50,527 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:50,527 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:51,528 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:51,528 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:39:51,529 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:52,528 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:52,529 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:53,529 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:53,529 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:54,529 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:54,530 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:55,530 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:55,531 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:56,531 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:56,531 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:56,532 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:39:57,531 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:57,532 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:58,532 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:58,532 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:39:59,532 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:39:59,533 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:00,534 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:00,535 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:01,534 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:01,534 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:01,535 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:40:02,534 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:02,535 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:03,535 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:03,535 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:04,535 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:04,536 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:05,536 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:05,537 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:06,537 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:06,537 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:06,538 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:40:07,537 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:07,538 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:08,538 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:08,539 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:09,539 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:09,539 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:10,539 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:10,540 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:11,540 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:11,540 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:11,541 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:40:12,540 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:12,541 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:13,541 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:13,542 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:14,542 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:14,542 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:15,542 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:15,543 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:16,543 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:16,543 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:16,544 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:40:17,543 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:17,544 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:18,544 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:18,545 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:19,545 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:19,545 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:20,545 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:20,546 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:21,546 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:21,546 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:21,547 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:40:22,546 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:22,547 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:23,547 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:23,547 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:24,547 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:24,548 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:25,548 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:25,549 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:26,549 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:26,549 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:40:26,550 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:27,549 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:27,550 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:28,550 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:28,551 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:29,553 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:29,554 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:30,554 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:30,554 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:31,554 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:31,555 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:31,555 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:40:32,555 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:32,555 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:33,556 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:33,557 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:34,556 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:34,557 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:35,557 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:35,557 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:36,557 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:36,558 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:40:36,558 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:37,558 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:37,559 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:38,559 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:38,559 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:39,559 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:39,560 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:40,560 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:40,561 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:41,561 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:41,561 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:41,562 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: status_report
2023-08-31 13:40:42,561 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:42,562 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:43,562 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:43,563 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:44,563 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:44,564 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit
2023-08-31 13:40:45,563 DEBUG HandlerThread:1465 [handler.py:handle_request():144] handle_request: poll_exit
2023-08-31 13:40:45,564 DEBUG SenderThread:1465 [sender.py:send_request():406] send_request: poll_exit

Hi @snorfyang , thank you for providing the log. The errors are pointing to the run failing to connect to our backend. This usually points to network/environment related setup.

  • Could you execute a test run in offline mode then sync it. Does it sync successfully
  • Could you create a new env and retest your code
  • Are you working behind a proxy or strict network settings, this is our official docs on dealing with network related problems

Hi @snorfyang , since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know!

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.