Haodong Tian

I fixed with: ```bash sudo dnf install gcc-toolset-13-gcc gcc-toolset-13-gcc-c++ source /opt/rh/gcc-toolset-13/enable make ```

I've identified and reproduced the issue: whenever files are attached to the request -- whether they are web search results, uploaded documents, or other types -- the `generate_queries` handler is...

> [@tth37](https://github.com/tth37) I believe this is fixed by this [#12958](https://github.com/open-webui/open-webui/pull/12958) > > The call to do web-search was blocking. It will now be async @gaby Are you sure? 🤔 I've...

> You mean `/api/chat/completion` should return even though the search is not done? Yes it is exactly what I mean. I think `/api/chat/completion` should return as soon as possible (as...

There is always a websocket connection alive in the background, which is responsible for updating response status.  For now `/api/chat/completion` is indeed returned *before the AI response is fully...

Yes that's the case where `stream` parameter is set to `False`, in that case the handler will fallback to the original response. https://github.com/open-webui/open-webui/blob/b8fb4e528dc2629acf68b9a555a59fd0173aaa51/backend/open_webui/utils/middleware.py#L2265-L2266 When `stream=False`, the `/api/chat/completions` is a synchronous...

@gaby @rgaricano Thank you for your attention! I've updated the issue for better describing the problem.

You can easily enable the very basic version of this feature by applying change like this: [test_async_chat_completion](https://github.com/tth37/open-webui/commit/316adbb085219b2157f230791b6c5f5765b3c52a) (Yet only support asynchronous calling together with websocket)

(Just throwing this out for discussion) What do you think about implementing this feature as a new Web Loader Engine instead (e.g., `snippet_only`, `empty_loader`, etc.)? Would that be another viable...

> I also considered designing it this way, but after reading the implementation of the [process_web](https://github.com/open-webui/open-webui/blob/07d8460126a686de9a99e2662d06106e22c3f6b6/backend/open_webui/routers/retrieval.py#L1218) function, I found it wasn't appropriate. > > open_webui provides a process_web function that...