How to track perplexity?

Hello,
I’m training some nlp models with huggingface, and I’d like wandb to track the perplexity. How do I do this?

Hello Francis,

Thank you for contacting support! I will get back to you on that!

Hello Francis,

Thank you for your patience! Are you looking to log perplexity during training cycles or across various fully trained language models for comparison?
You can report perplexity like it is done here and put in a wandb.log() for tracking perplexity.

Please let me know.

Hello Francis,

Have you tried my suggestion?

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.