# Issue with grid sweep **URL:** \ **Category:** W&B Help\ **Tags:** sweeps\ **Created:** [April 1, 2024, 2:26pm UTC](https://community.wandb.ai/t/issue-with-grid-sweep/6264 "2024-04-01T14:26:53Z")\ **Posts on this page:** 7\ **Page:** 1
**Author:** ![wadeschulzyale](https://sea2.discourse-cdn.com/flex020/user_avatar/community.wandb.ai/wadeschulzyale/32/1743_2.png) [@wadeschulzyale](https://community.wandb.ai/u/wadeschulzyale)\ **Post date:** [April 1, 2024, 2:26pm UTC](https://community.wandb.ai/t/issue-with-grid-sweep/6264/1 "2024-04-01T14:26:53Z")
Running into an issue that started late last week when trying to run a grid sweep. The estimated number of runs is 5292, but when the sweep reaches run number 300, the API server quits issuing new runs. The sweep is still in the started state and looks active, with the agents reporting a heartbeat, but on the client/agent, it looks as if the run is paused: ```auto 2024-03-31 23:55:40,348 - wandb.wandb_agent - INFO - Running runs: [] ``` Pausing/resuming the run has no effect on this. If I stop the agent and try to relaunch it, the heartbeat disconnects but instead of connecting gives the following error: ```auto wandb: Starting wandb agent 🕵️ wandb: Network error (ReadTimeout), entering retry loop. client_loop: send disconnect: Broken pipe ``` The cli logs show: ```auto socket.timeout: The read operation timed out urllib3.exceptions.ReadTimeoutError: HTTPSConnectionPool(host='api.wandb.ai', port=443): Read timed out. (read timeout=20) requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='api.wandb.ai', port=443): Read timed out. (read timeout=20) ``` The network connection itself is fine, I can create a new sweep from the same device and it will start a new set of runs, but similarly stops when it hits run 300 (have tried 3 separate times). ---
**Author:** ![uma-wandb](https://avatars.discourse-cdn.com/v4/letter/u/b77776/32.png) [@uma-wandb](https://community.wandb.ai/u/uma-wandb)\ **Post date:** [April 4, 2024, 5:27pm UTC](https://community.wandb.ai/t/issue-with-grid-sweep/6264/2 "2024-04-04T17:27:27Z")
hey @wadeschulzyale - would it be possible to provide the `debug.log`​and `debug-internal.log` files associated with a run from the error? They should be located in the `wandb` folder in the same directory as where the script was run. The `wandb` folder has folders formatted as `run-DATETIME-ID` associated with a single run. ---
**Author:** ![wadeschulzyale](https://sea2.discourse-cdn.com/flex020/user_avatar/community.wandb.ai/wadeschulzyale/32/1743_2.png) [@wadeschulzyale](https://community.wandb.ai/u/wadeschulzyale)\ **Post date:** [April 5, 2024, 4:24pm UTC](https://community.wandb.ai/t/issue-with-grid-sweep/6264/3 "2024-04-05T16:24:15Z")
@uma-wandb Would be happy to - is there an address I can send it to you at? The runs themselves completed fine, and not noticing anything in the run-level logs that demonstrates an error, which seems to be at the sweep level which does not send new runs to the client, and if the client is stopped and attempted reconnect, the above error/logs are created for the sweep ID. Thanks, Wade ---
**Author:** ![wadeschulzyale](https://sea2.discourse-cdn.com/flex020/user_avatar/community.wandb.ai/wadeschulzyale/32/1743_2.png) [@wadeschulzyale](https://community.wandb.ai/u/wadeschulzyale)\ **Post date:** [April 7, 2024, 10:49pm UTC](https://community.wandb.ai/t/issue-with-grid-sweep/6264/4 "2024-04-07T22:49:10Z")
Hi @uma-wandb - just wanted to check back on whether there was somewhere you’d like me to send the additional logs or any feedback on the underlying sweep scheduling. Thanks, Wade ---
**Author:** ![fmamberti-wandb](https://avatars.discourse-cdn.com/v4/letter/f/839c29/32.png) [@fmamberti-wandb](https://community.wandb.ai/u/fmamberti-wandb)\ **Post date:** [April 10, 2024, 3:46pm UTC](https://community.wandb.ai/t/issue-with-grid-sweep/6264/5 "2024-04-10T15:46:06Z")
Hi @wadeschulzyale - truly sorry for the late reply here. Could you please send that to [support@wandb.com](mailto:support@wandb.com) and we can keep troubleshooting from there? Thanks! ---
**Author:** ![uma-wandb](https://avatars.discourse-cdn.com/v4/letter/u/b77776/32.png) [@uma-wandb](https://community.wandb.ai/u/uma-wandb)\ **Post date:** [April 16, 2024, 10:16am UTC](https://community.wandb.ai/t/issue-with-grid-sweep/6264/6 "2024-04-16T10:16:05Z")
hey @wadeschulzyale - were you able to send over the debug logs to [support@wandb.com](mailto:support@wandb.com)? this would be super helpful in root causing this, thanks again! ---
**Author:** ![uma-wandb](https://avatars.discourse-cdn.com/v4/letter/u/b77776/32.png) [@uma-wandb](https://community.wandb.ai/u/uma-wandb)\ **Post date:** [April 22, 2024, 9:00pm UTC](https://community.wandb.ai/t/issue-with-grid-sweep/6264/7 "2024-04-22T21:00:10Z")
Hi @wadeschulzyale , since we have not heard back from you we are going to close this request. If you would like to re-open the conversation, please let us know!