Matt Hoffner

Fixes `error loading model: unrecognized tensor type 7` to support newer local ggml models

feat: GGML model support

4

### Feature request Being able to use GGML models using ctransformers https://github.com/marella/ctransformers or llama.cpp https://github.com/abetlen/llama-cpp-python ### Motivation CPU support for Starcoder and eventually Falcon models, and overall perf improvements. ###...

Awesome project

1

First off thanks for creating this! I created a forked version of this with some OpenAI chat by parsing codeblocks from a chat and writing to the editor: Demo: https://codetree-ai.netlify.app/...

Langchain integration

3

Adding web-llm as a LLM in Langchain would be really useful. https://js.langchain.com/docs/getting-started/guide-llm For example it would be nice to have a web-llm option that works similar to the OpenAI one....

Interesting project! The "remix this glitch" link does not for me.

First, thanks for putting this project together. Got a chance to run locally a while back without issue. Very interested in whether adding support for React's streaming renderer (renderToNodeStream) has...