# Sweeps: Waiting for W&B process to finish... (failed 1)

**URL:** <https://community.wandb.ai/t/sweeps-waiting-for-w-b-process-to-finish-failed-1/4012>\
**Category:** W&B Help\
**Tags:** sweeps, projects, wandb\
**Created:** [March 7, 2023, 3:01am UTC](https://community.wandb.ai/t/sweeps-waiting-for-w-b-process-to-finish-failed-1/4012 "2023-03-07T03:01:12Z")\
**Posts on this page:** 8\
**Page:** 1

<div class="post-metadata">

**Author:** ![aryamohan23](https://avatars.discourse-cdn.com/v4/letter/a/e95f7d/32.png) [@aryamohan23](https://community.wandb.ai/u/aryamohan23)\
**Post date:** [March 7, 2023, 3:01am UTC](https://community.wandb.ai/t/sweeps-waiting-for-w-b-process-to-finish-failed-1/4012/1 "2023-03-07T03:01:12Z")

</div>

Hi everyone,  
I am trying to sweep my hyperparameters for my TensorFlow model. I am using Bayes as the sweeping method.

In my `train()` function, I have several `.fit()` methods as I am training a progressive GAN and I am required to call `model.fit()` several times.

After completing the first `model.fit()` successfully, the error

```auto
Waiting for W&B process to finish... (failed 1)

```

What should I do?

I followed this tutorial here to use Wandb sweeps: [Google Colab](https://colab.research.google.com/github/wandb/examples/blob/master/colabs/tensorflow/Hyperparameter_Optimization_in_TensorFlow_using_W%26B_Sweeps.ipynb#scrollTo=_7eXIA019vAG)

And here is a look at my `sweep_train()` function:

```auto
def sweep_train(config_defaults=None):

    # Initialize wandb with a sample project name
    run = wandb.init(config=config_defaults, resume=True)  
    
    pgan = PGAN(latent_dim = NOISE_DIM, d_steps = wandb.config.D_STEPS)
    

    cbk = GANMonitor(num_img = NUM_IMGS_GENERATE, latent_dim = NOISE_DIM)

    cbk.set_steps(steps_per_epoch = STEPS_PER_EPOCH, epochs = wandb.config.EPOCHS) # 110, 6
    cbk.set_prefix(prefix='0_init')

    
    
    train(wandb.config.G_LR, wandb.config.D_LR, wandb.config.R_LR, wandb.config.EPOCHS, wandb.config.D_STEPS, cbk, pgan)

    run.finish()

```

---

<div class="post-metadata">

**Author:** ![raphael-sanandres](https://avatars.discourse-cdn.com/v4/letter/r/7cd45c/32.png) [@raphael-sanandres](https://community.wandb.ai/u/raphael-sanandres)\
**Post date:** [March 9, 2023, 9:27pm UTC](https://community.wandb.ai/t/sweeps-waiting-for-w-b-process-to-finish-failed-1/4012/2 "2023-03-09T21:27:38Z")

</div>

Hello @aryamohan23!

Is there more details to the traceback such as right before `Waiting for W&B process to finish... (failed 1)`? There should be a traceback into the code detailing what error is causing the project to fail. W&B will also upload all runs regardless of status (success, failed, crashed, etc.) so the `(failed 1)` message is indicating the state of the run.

---

<div class="post-metadata">

**Author:** ![raphael-sanandres](https://avatars.discourse-cdn.com/v4/letter/r/7cd45c/32.png) [@raphael-sanandres](https://community.wandb.ai/u/raphael-sanandres)\
**Post date:** [March 14, 2023, 11:03pm UTC](https://community.wandb.ai/t/sweeps-waiting-for-w-b-process-to-finish-failed-1/4012/3 "2023-03-14T23:03:58Z")

</div>

Hi there, I wanted to follow up on this request. Please let us know if we can be of further assistance or if your issue has been resolved.

---

<div class="post-metadata">

**Author:** ![aryamohan23](https://avatars.discourse-cdn.com/v4/letter/a/e95f7d/32.png) [@aryamohan23](https://community.wandb.ai/u/aryamohan23)\
**Post date:** [March 15, 2023, 10:50am UTC](https://community.wandb.ai/t/sweeps-waiting-for-w-b-process-to-finish-failed-1/4012/4 "2023-03-15T10:50:16Z")

</div>

Hello, sorry for the delay. I get this error:

`wandb: ERROR Dropped streaming file chunk (see wandb/debug-internal.log)`

I realized it was a network issue and so i set my wandb to offline mode. But even when I try to sync it with a `wandb sync` i get the same error.

---

<div class="post-metadata">

**Author:** ![raphael-sanandres](https://avatars.discourse-cdn.com/v4/letter/r/7cd45c/32.png) [@raphael-sanandres](https://community.wandb.ai/u/raphael-sanandres)\
**Post date:** [March 20, 2023, 9:25pm UTC](https://community.wandb.ai/t/sweeps-waiting-for-w-b-process-to-finish-failed-1/4012/5 "2023-03-20T21:25:41Z")

</div>

Hello Arya!

Could you provide the `debug.log` and `debug-internal.log` fore the run? They should be located in the `wandb` folder in the same directory as where the script was run. The `wandb` folder has folders formatted as `run-DATETIME-ID` associated with a single run. Could you retrieve the `debug.log` and `debug-internal.log` files from one of these folders specifically from the run that is having issues?

---

<div class="post-metadata">

**Author:** ![raphael-sanandres](https://avatars.discourse-cdn.com/v4/letter/r/7cd45c/32.png) [@raphael-sanandres](https://community.wandb.ai/u/raphael-sanandres)\
**Post date:** [March 23, 2023, 11:45pm UTC](https://community.wandb.ai/t/sweeps-waiting-for-w-b-process-to-finish-failed-1/4012/6 "2023-03-23T23:45:19Z")

</div>

Hi there, I wanted to follow up on this request. Please let us know if we can be of further assistance or if your issue has been resolved.

---

<div class="post-metadata">

**Author:** ![aryamohan23](https://avatars.discourse-cdn.com/v4/letter/a/e95f7d/32.png) [@aryamohan23](https://community.wandb.ai/u/aryamohan23)\
**Post date:** [April 1, 2023, 1:23pm UTC](https://community.wandb.ai/t/sweeps-waiting-for-w-b-process-to-finish-failed-1/4012/7 "2023-04-01T13:23:11Z")

</div>

Hello, sorry to come back to this late.  
I seem to have resolved this one issue, it seems to just a VPN issue.  
However, now my logged images are not reflectibng on the ‘Charts’ tab on my dashboard, even though all my images can be seen in the ‘files’ tab.  
The run also shows as ‘crashed’ even though the files are logged.

Attached the debug and debug-internal files:  
[debug-internal](https://drive.google.com/file/d/1V692jCGDPkgrtJOVM7bGPrqFEi2GikYZ/view?usp=sharing)  
[debug](https://drive.google.com/file/d/1dG6-PWeJhRLVzDhTOBLIpi9N20tVMk6-/view?usp=sharing)

Thanks in advance

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex020/uploads/wandb/original/1X/366b649231631dbab896843020da0056074ac79d.png) [@system](https://community.wandb.ai/u/system)\
**Post date:** [May 31, 2023, 1:23pm UTC](https://community.wandb.ai/t/sweeps-waiting-for-w-b-process-to-finish-failed-1/4012/8 "2023-05-31T13:23:56Z")

</div>

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.
