Feature Request: Local Server to Integrate with AI Chat Interface

[harshitlakhani]

I am developing llmchat.co, an open source local first chat interface. We do have integrations with Ollama, and LM Studio but one of the biggest hurdles that our initial users are telling us is not having a powerful enough machine to run these SLMs smoothly, we want to provide them BitNet access through local server. This project shows greater hope for local first products.

[Daddyof2Texas]

Awesome I'm #23 and I'm all in let's get this rolling

[dawnmsg]

We will consider it. We also encourage you contribute to this feature. Feel free to make a PR once completed.