Mike Taylor

Ah yes it's specifically when I run `python convert.py models/lora_fused_model --outfile models/lora_fused_model-fp16.gguf --outtype f16`. It's this script in llama.cpp that everybody online recommends to use to convert to gguf (unaware...

Yes happy to do that, what do I need to edit?

Thanks for looking into it @madroidmaq , I'll give it a try with the `convert-hf-to-gguf.py` and report back. Potentially something only occuring on mac @mzbac. I was very religiously following...

Hey I'm not maintaining this anymore. Wouldn't recommend using it but feel free to take the useful parts for your own projects. On Sun, Mar 24, 2024, 07:54 sangeedutta ***@***.***>...

hey I haven't messed with those params, I am usually testing video ads so I need the whole thing. but yeah optional metadata seems like the right approach