Mykhailo Marynenko
Mykhailo Marynenko
🫣
The current `ghcr.io/bentoml/openllm:latest` image (`sha256:1860863091163a8e8cb1225c99d6e1b0735c11871e14e8d8424a22a5ad6742fa`) shows an error: ```console ValueError: The checkpoint you are trying to load has a model type of `cohere`, which Transformers does not recognize. This may...
whisper.cpp does not provide SRT ouput, but there is a project that can convert its output to .srt: [WhisperSub](https://github.com/mcdallas/whispersub).
In some cases, if DNS resolves to an IPv6 address for `NUXT_REDIS_HOST`, it may not work because the family for io-redis is not specified. This prevents deploying the application when...
Also, thanks for the nice project! Hopefully, it can become a popular solution for queues and scheduling in Nuxt. I've used BullMQ in several production projects, finding it reliable and...
Looks like it was released in [v0.4.0](https://github.com/vllm-project/vllm/releases/tag/v0.4.0) / #3433
I know, do you have any suggestions for other services that could provide better results?
YSEQ looks promising: https://yseq.net/
This would be cool in combination with something like Redis to monitor and balance requests. An orchestration layer could ensure models are pulled on specific nodes. Additionally, the ability to...
@dosu `initializeAgentExecutorWithOptions` is deprecated, extending GmailBaseTool defeats the whole purpose of those tools being implemented inside langchain. Escalate to respective maintainers.