deepset-ai
Active Human Involvement in AI Application
This is probably a bit too early for a feature request, but might still worth discussing.
In some AI applications like Cursor and Claude Code (and maybe some other vibe coding products), users can provide extra inputs while the agent/application is running, without interrupting the execution flow. The agent/application is not explicitly waiting for human response (as compared to standard human-in-the-loop design), but takes the input into the current architecture in a natural way.
My questions are as follows: (1) Are there any other AI applications that have this feature right now, and what purpose do they serve? (2) What’s the recommended way to achieve that in Haystack? My reflection is that this might be tricky in haysatck, since the execution loop is rather pre-determined, (compared to pure agent/multi-a setup) and there is less room to backstep and fix the error.
Actually this might not be that hard in term of the actual implementation. Instead of awaiting human input, we can just set up an input buffer queue and attempt to pop human messages if not empty. @vblagoje wdyt?
@LastRemote the best person to brainstorm with on this topic is @sjrl as he worked on HITL mechanism for Agent
