Add backwards-compatibility for older model format
Add support for reading older model files so that people do not have to throw out ggml alpaca models.
There has been a conversion script posted previously:
ggerganov/llama.cpp/issues/324#issuecomment-1476227818
with a link to this script:
https://gist.github.com/eiz/828bddec6162a023114ce19146cb2b82
I tried it once and it worked for me. Note that you might have to use the --n_parts 1 command-line arg when calling main with the converted params, as the script just generates a 1-part weights file.
I think the conversion script should be included in the repository somewhere to be honest. It's worked for every old format model I've thrown at it and saved me a lot of time.
I think the conversion script should be included in the repository somewhere to be honest. It's worked for every old format model I've thrown at it and saved me a lot of time.
yea, i suggested that in that thread, and got approved. no one actually bothered to do it. @eiz
There has been a conversion script posted previously:
ggerganov/llama.cpp/issues/324#issuecomment-1476227818
with a link to this script:
https://gist.github.com/eiz/828bddec6162a023114ce19146cb2b82
I tried it once and it worked for me. Note that you might have to use the
--n_parts 1command-line arg when callingmainwith the converted params, as the script just generates a 1-part weights file.
OK, that was what I wanted to do in the first place but I could find the script. I'll make a merge request with this script instead.