Jeff Keegan

The output of my netcat (nc) command: > $ nc 127.0.0.1 9990 > POST /v1/chat/completions HTTP/1.0 > > HTTP/1.1 200 OK > Content-Type: application/json; charset=utf-8 > Content-Length: 2242 > >...

Similarly if I do this curl command with no headers, no json message, etc, I get random German text: $ curl -X POST http://10.0.0.1:9990/v1/chat/completions That yielded: > 🔸**Mein Interesse an...

I think it would also allow you to use distributed-llama in API mode (another local LLM solution, whose API mode is compatible with part of the OpenAI API).