BitNet
BitNet copied to clipboard
ggml-model-i2_s.gguf gives magic file error when adding to Ollama
I have successfully implemented BitNet but when I am trying to add it to Ollama with "ggml-model-i2_s.gguf" it fails:
ollama create bitnet -f Modelfile
transferring model data 100%
Error: invalid file magic
I can use the other gguf file "ggml-model-f32.gguf" for this, but first it take long to transfer to Ollama and second, it become very slow, size of 32G.
Is there any remedy for this?
What is the modelfile looks like ? may you share ?
I don't think Ollama support bitnet's i2_s gguf format at this time...