Could wandb be used in the inference?

W&B Help
1

Could wandb be used in the inference stage? I’m specifically interested in collecting system metrics during inference. I’m working with DeepSpeed and torch profile and would to know if wandb could be useful in the inference as well.

2

Hi @eneas-jr,

Yes, wandb can definitely be used at inference time as well to record system metrics. wandb will record system metrics in between the calls to wandb.init() and wandb.finish().

Thanks,
Ramit

3

Thanks a lot, @ramit_goolry