Pete Keavney comments

Results 3 comments of


                                            Pete Keavney

Eval bug: Loading fail on Gemma 3:12b > llama_model_load: error loading model: error loading model hyperparameters: key not found in model: gemma3.attention.layer_norm_rms_epsilon

I pulled gemma3:27b (a418f5838eaf) three days ago. runs fine from Ollama CLI, however getting this error when loading into LM Studio. [gemma3 load error.txt](https://github.com/user-attachments/files/21039860/gemma3.load.error.txt)

Eval bug: Loading fail on Gemma 3:12b > llama_model_load: error loading model: error loading model hyperparameters: key not found in model: gemma3.attention.layer_norm_rms_epsilon

Negative. I'm not up for spending hours or more likely days updating gemma's attention hyperparams, especially when the problem may be with LmStudio's api. I will, however try loading the...

Eval bug: Loading fail on Gemma 3:12b > llama_model_load: error loading model: error loading model hyperparameters: key not found in model: gemma3.attention.layer_norm_rms_epsilon

The Gemma3:27b model loads and runs in AnythingLLM and as expected in Ollama's new UI. It's possible the problem originated from the conversion to gguf locally. You may want to...