Gautham Pai comments

Results 8 comments of


                                            Gautham Pai

Failure during overlay endpoints restore: restore network sandbox failed: network sandbox join failed: could not get network sandbox (oper true): failed get network namespace \"\": no such file or directory

> A workaround for me. First remove `cluster-store` and `cluster-advertise` in the daemon.json and restart the `docker` service. Then add them back and restart `docker` again. It works for me...

Proxy Websocket Support

+1 Would be great to have support for both HTTP/1.1 and WebSocket proxying.

Optimization dry runs

This would be a wonderful feature. I have 3 things in mind (not sure about how well this can be implemented as I don't yet have complete source code level...

Optimization dry runs

> One thought on Token Counting - would it make sense to build this directly into the LM abstraction? > > I imagine, while there may be some overlap in...

[WIP] Major refactor roadmap

+1 For supporting all OpenAI compatible local LLM servers for inferencing and not just Ollama. I think this will increase adoption because a lot of "application developers" of LMs who...

cant start without mongo auth

I am not a developer on this project, but I had a similar requirement. Somehow, even enabling auth didn't seem to work for me. So I just disabled auth and...

No step to set environment variables

Here is a crude solution that worked for me. Run the code in another Docker container and put both the containers in a single custom bridge network. ``` docker network...

Not in plugin repository

+1 Would be great if this plugin is added back!