Matt Hoffner

I've been writing some generic FastAPIs to try various ggml libraries using ctransformers: https://huggingface.co/spaces/matthoffner/wizardcoder-ggml https://huggingface.co/spaces/matthoffner/starchat-ggml I've made some recent updates to make the API match the OpenAI response format better...

Thanks @ParisNeo very cool I'm hoping to help get ctransformers added to OpenLLM as well: https://github.com/bentoml/OpenLLM/issues/24

These should still work: HuggingFace: https://huggingface.co/spaces/matthoffner/wizardcoder-ggml Github: https://github.com/matthoffner/ggml-fastapi

Thanks @lucasjinreal, I haven't seen this issue. Here are some recent UIs I built around WizardCoder if you are looking for some client side examples. Live HTML Editor: https://github.com/matthoffner/wizardcoder-sandbox Chatbot-ui:...

Thanks @cmp-nct I have a simple UI based off the official Falcon space uusing ggllm via ctransformers: https://huggingface.co/spaces/matthoffner/falcon-mini I've been building spaces on HF using ggml fastapis, I have a...

> > I have a simple UI based off the official Falcon space uusing ggllm via ctransformers: https://huggingface.co/spaces/matthoffner/falcon-mini > > FYI, just errors out at the moment.. Feel free to...