I am a novice in W&B yet, but I am enthusiastic in adding it to our projects. I just added some logging to one (a bit large) piece of code we have that involves model training. It worked well.
However I see that this code can be parallelized.
Now I put wandb.init in the beggining of the main script but put wandb.log in another different script that gets called somewhere else.
Will W&B still run correctly if the training is parallelized. Will the system performance logs also be correct?
Thanks