Islam Elsayed

feat: GPU Docker Image?

1

**Problem** A well crafted docker image would go a long way making the tool production ready. One can start running it in kubernetes pods and see how it goes. Currently...

### Describe the bug I was working on a personal project 5 months ago which had dbt, and this package, everything was working well. Now as I was trying to...

vLLM/OpenAI Compatible Endpoint

5

**Is your feature request related to a problem? Please describe.** vLLM backend works well and is easy to set up, compared to TensorRT which had me pulling my hair. However...

Any good open source LLMs for zep's summarization?

2

This is not a feature/bug, just a question, since there is no discussion board I'll leave it here. I have multiple hugging face models hosted and running OpenAI compatible endpoints....