Wandb: 429 encountered (Filestream rate limit exceeded, retrying in 8.4 seconds.), retrying request

When I was using wandb to log experiment data, I suddenly encountered this error: ‘wandb: 429 encountered (Filestream rate limit exceeded, retrying in 8.4 seconds.), retrying request.’ I was using version 0.13.5, and even after updating to 0.17.7, the issue still persists. Could you help me resolve this problem?

Hi @jifeng ,

Apologies as we encountered some issues this weekend that resulted to Rate Limit errors. Our engineers were aware of this and took care of it. Could you please try logging again and confirm if it is now working on your end?

Thanks,
Joana Marie

I am facing the same issue here for the last 3 days… and after spme time the processes is crashed… ! any solution?

The issue has been resolved. What I can confirm at the moment is that, for some reason, there was a blockage in the data upload process in process A. This caused process A to frequently request the wandb server to upload data, leading to frequent failures. In this situation, any processes started after process A were unable to upload data properly, resulting in the aforementioned error. If you stop process A, the other processes can upload data successfully.