(Mac VsCode) Internal wandb error: file data was not synced

W&B Help
1

please see the following error and help me how I can resolve it. To let you know, I ran sweeps with the same yml file a number of times with the same virtual envrionment and this is the first time facing this error.

INFO:root:* Loading data…
INFO:root: Data Parameters:
INFO:root: - Downsample: True
INFO:root: - Features: 5
INFO:root: - Scale Features: True
INFO:root: - Scaler: standard
INFO:root: - Feature Selection Method: quantum-bqm
INFO:root: * Using existing data file: data/processed/ca_dTrue_f5_sTrue_standard_pquantum-bqm.csv
INFO:root:* Preparing data…
INFO:root:* Uploading artifacts…
Thread SenderThread:
Traceback (most recent call last):
File “/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/wandb/sdk/internal/internal_util.py”, line 49, in run
self._run()
File “/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/wandb/sdk/internal/internal_util.py”, line 100, in _run
self._process(record)
File “/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/wandb/sdk/internal/internal.py”, line 328, in _process
self._sm.send(record)
File “/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/wandb/sdk/internal/sender.py”, line 389, in send
send_handler(record)
File “/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/wandb/sdk/internal/sender.py”, line 411, in send_request
send_handler(record)
File “/Library/Frameworks/Python.framework/Versions/3.11/lib/python3.11/site-packages/wandb/sdk/internal/sender.py”, line 1460, in send_request_log_artifact
assert record.control.mailbox_slot
AssertionError
wandb: ERROR Internal wandb error: file data was not synced
Exception in thread NetStatThr:
Traceback (most recent call last):
Exception in thread File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/threading.py”, line 980, in _bootstrap_inner
IntMsgThr:
Traceback (most recent call last):
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/threading.py”, line 980, in _bootstrap_inner
self.run()self.run()

File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/threading.py”, line 917, in run
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/threading.py”, line 917, in run
self._target(*self._args, **self._kwargs)
self._target(*self._args, **self._kwargs)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/wandb_run.py”, line 268, in check_network_status
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/wandb_run.py”, line 300, in check_internal_messages
self._loop_check_status(
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/wandb_run.py”, line 224, in _loop_check_status
local_handle = request()
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/interface/interface.py”, line 848, in deliver_network_status
self._loop_check_status(
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/wandb_run.py”, line 224, in _loop_check_status
local_handle = request()
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/interface/interface.py”, line 856, in deliver_internal_messages
return self._deliver_internal_messages(internal_message)
return self._deliver_network_status(status)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/interface/interface_shared.py”, line 516, in _deliver_internal_messages
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/interface/interface_shared.py”, line 510, in _deliver_network_status
return self._deliver_record(record)return self._deliver_record(record)

File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/interface/interface_shared.py”, line 459, in _deliver_record
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/interface/interface_shared.py”, line 459, in _deliver_record
handle = mailbox._deliver_record(record, interface=self)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/lib/mailbox.py”, line 455, in _deliver_record
handle = mailbox._deliver_record(record, interface=self)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/lib/mailbox.py”, line 455, in _deliver_record
interface._publish(record)interface._publish(record)

File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/interface/interface_sock.py”, line 51, in _publish
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/interface/interface_sock.py”, line 51, in _publish
self._sock_client.send_record_publish(record)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/lib/sock_client.py”, line 221, in send_record_publish
self.send_server_request(server_req)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/lib/sock_client.py”, line 155, in send_server_request
self._send_message(msg)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/lib/sock_client.py”, line 152, in _send_message
self._sendall_with_error_handle(header + data)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/lib/sock_client.py”, line 130, in _sendall_with_error_handle
sent = self._sock.send(data)
BrokenPipeError: [Errno 32] Broken pipe
self._sock_client.send_record_publish(record)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/lib/sock_client.py”, line 221, in send_record_publish
self.send_server_request(server_req)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/lib/sock_client.py”, line 155, in send_server_request
self._send_message(msg)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/lib/sock_client.py”, line 152, in _send_message
self._sendall_with_error_handle(header + data)
File “/Users/erin/miniconda3/envs/qnn_feature_selection/lib/python3.9/site-packages/wandb/sdk/lib/sock_client.py”, line 130, in _sendall_with_error_handle
sent = self._sock.send(data)
BrokenPipeError: [Errno 32] Broken pipe

2

Hi @seungjoo-lee! Thank you for writing in.

Could you please talk a bit about your environment setup as well as what version of wandb you are currently using?

Could you please provide the debug.log and debug-internal.log files associated with the run where you are running into this issue? These files should be located in the wandb folder relative to your working directory.

3

Hi there, I wanted to follow up on this request. Please let us know if we can be of further assistance or if your issue has been resolved.

4

Hi,

Thank you for the support. I am still facing the same issue. Could you please let me know what information you need for further assistance?

5

I found the debug.log and debug-internal.log files associated with the run I am asking for support. Could you provide an email address to where I can send them?

Thank you.

6

Sweet! Could you please send them my way to artsiom.skarakhod@wandb.com?

7

Hi there, I wanted to follow up on this request. Please let us know if we can be of further assistance or if your issue has been resolved.

8

Hi, since we have not heard back from you, we are going to close this request. If you would like to reopen the conversation, please let us know! Unfortunately, at the moment, we do not receive notifications if a thread reopens on Discourse. So, please feel free to create a new ticket regarding your concern if you’d like to continue the conversation.