marcker

Results 4 comments of marcker

Is there a plan to release the weights? Or is this a bug in loading them?

The app will launch a web browser to sign you into your Amazon account. After doing that, everything should work as expected.

Some instructions on converting from HF to GGUF are here: https://github.com/ggerganov/llama.cpp/discussions/2948 -- let us know if you try it!