`temperature` (=0.0) has to be a strictly positive float, otherwise your nex

[yxl502]

[yxl502]

[david0963658]

By setting temperature=0.7 in the model.generate function, the error resolved. generated_ids = model.generate( **model_inputs, max_new_tokens=512, temperature=0.7 )