vinvcn

Could not parse LLM output: I'm not familiar with "bla". Would you like me to search for more information on it? ``` Traceback (most recent call last): File "/Users/admin/Library/Caches/pypoetry/virtualenvs/kbgpt-I7QBBX8f-py3.10/lib/python3.10/site-packages/langchain/agents/chat/base.py", line...

[Feature]: Add Redis as a VectorStore

1

### Is your feature request related to a problem? Please describe. Redis is a really popular vector store and caching database which is used by the industry such as fintech....

Is there a way to optimize the output token per second?

1

Hi there, I understand autoregression which outputs words one by one. With some manual benchmark, our deployment gives 50 English words in 6 seconds. Is there a way to optimize...

Is there a possible solution for deploying Whisper-Jax on Sagemaker?

```python from whisper_jax import FlaxWhisperPipline # instantiate pipeline pipeline = FlaxWhisperPipline("openai/whisper-large-v2") # JIT compile the forward call - slow, but we only do once text = pipeline("audio.mp3") ``` How can...

[Enhancement]: Async function calls to improve the concurrency

2

### What would you like to be added? Hi, I did a brief study on the code base we have here. Seems the most part that involves external I/O is...

### Prerequisite - [x] I have searched [Issues](https://github.com/open-compass/opencompass/issues/) and [Discussions](https://github.com/open-compass/opencompass/discussions) but cannot get the expected help. - [x] The bug has not been fixed in the [latest version](https://github.com/open-compass/opencompass). ### Type...