GraphQL HTTP Error 500

W&B Help
1

Hi,

Over the last hour, my runs are hanging due to 500 Server Error: Internal Server Error for url: https://api.wandb.ai/graphql. I tried updating wandb to latest version, error still persists. The internal log is below:

2024-10-23 11:04:19,384 DEBUG   HandlerThread:2770649 [handler.py:handle_request():158] handle_request: internal_messages
2024-10-23 11:04:21,006 ERROR   SenderThread:2770649 [internal_api.py:execute():349] 500 response executing GraphQL.
2024-10-23 11:04:21,006 ERROR   SenderThread:2770649 [internal_api.py:execute():350] {"errors":[{"message":"An internal error occurred. Please contact support.","path":["createArtifactManifest"]}],"data":{"createArtifactManifest":null}}
2024-10-23 11:04:21,006 INFO    SenderThread:2770649 [retry.py:__call__():172] Retry attempt failed:
Traceback (most recent call last):
  File "/home/eerturk/miniconda3/envs/venv/lib/python3.8/site-packages/wandb/sdk/lib/retry.py", line 131, in __call__
    result = self._call_fn(*args, **kwargs)
  File "/home/eerturk/miniconda3/envs/venv/lib/python3.8/site-packages/wandb/sdk/internal/internal_api.py", line 345, in execute
    return self.client.execute(*args, **kwargs)  # type: ignore
  File "/home/eerturk/miniconda3/envs/venv/lib/python3.8/site-packages/wandb/vendor/gql-0.2.0/wandb_gql/client.py", line 52, in execute
    result = self._get_result(document, *args, **kwargs)
  File "/home/eerturk/miniconda3/envs/venv/lib/python3.8/site-packages/wandb/vendor/gql-0.2.0/wandb_gql/client.py", line 60, in _get_result
    return self.transport.execute(document, *args, **kwargs)
  File "/home/eerturk/miniconda3/envs/venv/lib/python3.8/site-packages/wandb/sdk/lib/gql_request.py", line 59, in execute
    request.raise_for_status()
  File "/home/eerturk/miniconda3/envs/venv/lib/python3.8/site-packages/requests/models.py", line 1021, in raise_for_status
    raise HTTPError(http_error_msg, response=self)
requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.wandb.ai/graphql

Does anyone have an idea how to solve this?

2

Same here, what did you do to solve it?

3

I just waited for a day, it got resolved by itself, I am not sure if there is a concrete way to solve it, I remember trying different versions of wandb but none worked…

4

Alright, thanks! I am facing such timeout a lot, lately. Unable to fully download my data since days, always trying again and again; going in batches now, but I would not have expected it to be such a pain to download my data from wandb.