commit4ever

Ubuntu 20.04 we run a small proxy that creates multiple ollama serve processes on diff ports. I have noticed in htop that there a ton of threads created but not...

Hi - is there any documentation that talks abt how attention types can be set ? There seem to be options as per the Mistral git. https://github.com/mistralai/mistral-src https://huggingface.co/docs/transformers/main/model_doc/mistral HF talks...

Give ability to change retry prompt and model/provider

2

**Is your feature request related to a problem? Please describe.** For complex queries mistral-intruct/others on ollama dont work and multiple retries still dont give a parseble soln. **Describe the solution...

Hi! It would be great if options items such as context, temperature, etc can be set for a prompt and conversation for a prompt. Finding this very useful! Regards,

Add Llama File support

1

This would massively valuable in terms of accessing small models with min infra. https://github.com/Mozilla-Ocho/llamafile

hi - are you looking to support ISDA agreements? sample agreement from EDGAR attached. Regards, Chan

add support for AWS codecommit

2

Would be great to have an option for some of us. Great tool!

1) If you can, please include a screenshot of your problem 2) Please include the name of your operating system 3) If you can, steps to reproduce are super helpful...

Embed in an existing React app

1

Hi - Is there anyways this can be embedded as a component in an existing React app already with a FastAPI backend? Thanks AISEE

Uisng pgbouncer with django-tenants and Citus

3

Hi @JelteF Hope u are well! You had suggested a solution in this ticket. https://github.com/django-tenants/django-tenants/issues/447 It works well to an extent but we keep getting hit with Advisory locks -...