Jared Taylor
Jared Taylor
Thanks, all this time I assumed the issue was with the gguf conversion but didn't realize the real issue is with the merging. The files I mentioned above are all...
Thanks a ton, that seems to have worked as I now have the "model-00001-of-00001.safetensors" files you mentioned, which I recall seeing on other models as well. Now I'm back to...
I tried using the base tokenizer, and I also added "tokenizer.save_pretrained("Falcon_merged")" to my code. Both returned the same error when using convert-hf-to-gguf.py: RuntimeError: shape '[71, 3, 64, 4544]' is invalid...