Error while calling W&B API: OOM command not allowed when used memory > 'maxmemory'

W&B Help
1

Hi,

I ran multiple sweeps, and at some point, most of the runs started crashing. I deleted those runs and relaunched them, but now I’m getting the following error:

ERROR: Error while calling W&B API: OOM command not allowed when used memory > 'maxmemory'. (<Response [500]>)

Could you help me troubleshoot this? Could this be because I reached the limit of runs in a day or there are too many W&B files stored? Could you help me troubleshoot this? Thanks!

2

Hi @qx66 we sincerely apologize for any inconvenience caused by the recent issue with Filestream rate limit errors. Our engineers have thoroughly investigated and resolved the problem. As of now, the system should be functioning normally, and you should no longer experience any related disruptions.

I am closing this ticket as the incident appears to be resolved, also noted in our status page: https://status.wandb.com/. However, if you continue to encounter any issues, please don’t hesitate to reach out. We will be more than happy to investigate further.