Kai Howard
Kai Howard
edit: Ubuntu 17.04, going to update to 18.04
Some things that might help you out: [gpt-j python bindings](https://github.com/marella/gpt4all-j) [llama python bindings](https://github.com/abetlen/llama-cpp-python) [similar issue](https://github.com/ggerganov/whisper.cpp/issues/9) [You could look around in kobold.cpp to see how they deal with it](https://github.com/LostRuins/koboldcpp)
https://github.com/NouamaneTazi/bloomz.cpp
This repo outdated and obsolete. Check out the ggml or llama.cpp repos.