jkfnc

OpenAI API against Azure OpenAI Deployment does not work

10

**To Reproduce** Give a full working code snippet that can be pasted into a notebook cell or python file. Make sure to include the LLM load step so we know...

https://docs.aws.amazon.com/amazonq/latest/business-use-dg/connectors-list.html

Ollama crashes on Llava on windows after passing image path OOM

6

Ollama crashes when tried with this for llava What's in this image? C:\Users\test\Downloads\pexels-oleksandr-p-321552.jpg

Will switching to SeamlessM4Tv2 be better

9

SeamlessM4Tv2 Released today seems to have all this and translation with streaming support ? Will it be better than Whisper and Coqui ?

Wsl2 Image

1

## Feature Request Wsl2 image to make use of Host GPU ### Description Would be good to have WSL2 talos image tar file for running on windows machines , as...

Feature Request: Req to support Structured output and JSON schema to GBNF

2

### Prerequisites - [X] I am running the latest code. Mention the version if possible as well. - [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md). - [X] I searched using keywords...

Feature Request: RPC Cuda Build to link with cudart dlls

2

### Prerequisites - [X] I am running the latest code. Mention the version if possible as well. - [X] I carefully followed the [README.md](https://github.com/ggerganov/llama.cpp/blob/master/README.md). - [X] I searched using keywords...

bolna-app-1 | 2024-07-15 19:57:55.916 INFO {whisper_transcriber} [transcribe] STARTED TRANSCRIBING whisper-app-1 | 2024-07-15 19:57:55.927 INFO {server} [accept] connection open whisper-app-1 | 2024-07-15 19:57:55.927 INFO {WhisperServer} [recv_audio] start receving audio whisper-app-1 |...

Req for comparison chart

5

Would be good to have a comparison chart like one on this page https://github.com/MeetKai/functionary