Save the best model from a particular sweep

While trying to save the the best model of a particular sweep ( out of a list of sweeps) it appears to be like its saving the last sweep of the model with a given hyper parameters. Any suggestions on how can I save the fine tuned model with a certain parameters after the completion of fine tuning?