How can I set temperatur of model when I reload Keras fine-tuned Gemma?

[XinyueZ]

[suryabhupa]

Is there a way in the sampler method you use to specify the temperature or sampling method (e.g. nucleus, top-k, etc.)?

[gustheman]

you can set the sampler for that, more information at the bottom in this tutorial: https://ai.google.dev/gemma/docs/keras_inference