Axel Söderlind comments

Results 4 comments of


                                            Axel Söderlind

🐛 Bug Report: Debugging middleware caught exception in streamed response at a point where response headers were already sent

Encountered the same issue on MacOs, when running ./setup.sh (with python in venv) -> Option 1. Got this stack trace: ``` ................................................................................................... llama_new_context_with_model: n_ctx = 2048 llama_new_context_with_model: freq_base = 10000.0...

🐛 Bug Report: Debugging middleware caught exception in streamed response at a point where response headers were already sent

It worked when I uploaded a document with the assertion commented out. However, commenting on the original bug. From what I have gathered so far (and please correct me if...

🐛 Bug Report: Debugging middleware caught exception in streamed response at a point where response headers were already sent

Update: I think the problem is that in this case we are loading the embedding function from this transformer: huggingface_sentence-transformers/all-mpnet-base-v2 which has embedding length of 768, but the index which...

🐛 Bug Report: Debugging middleware caught exception in streamed response at a point where response headers were already sent

I guess OpenAPI:s embeddings have length 1536, so that's why it would work when using the OpenAI API maybe?