BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

ggml-model-i2_s.gguf gives magic file error when adding to Ollama

Open geoej opened this issue 1 year ago • 2 comments

I have successfully implemented BitNet but when I am trying to add it to Ollama with "ggml-model-i2_s.gguf" it fails:

ollama create bitnet -f Modelfile
transferring model data 100% 
Error: invalid file magic

I can use the other gguf file "ggml-model-f32.gguf" for this, but first it take long to transfer to Ollama and second, it become very slow, size of 32G.

Is there any remedy for this?

geoej avatar Oct 31 '24 20:10 geoej

What is the modelfile looks like ? may you share ?

raymond-infinitecode avatar Dec 22 '24 08:12 raymond-infinitecode

I don't think Ollama support bitnet's i2_s gguf format at this time...

sd983527 avatar Apr 17 '25 08:04 sd983527