Bohan Qu
Bohan Qu
Update: I think we can conclude that reasoning tokens will not contain tool call/tool call result information, at least not in the standard/current way. I have found some research projects...
> it makes sense to perhaps add a property reasoning_text etc to ChatMessage I totally agree. This is actually what I am doing right now, adding a new field `_reasoning_content:...
I created an untested draft PR to illustrate the purposed changes. I will be away for the rest of the week, but feel free to take over.
Update: Claude 3.7 supports reasoning, in a non-standard way. https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking#understanding-thinking-blocks
> Ok @LastRemote regarding streaming response this [approach](https://github.com/deepset-ai/haystack/compare/main...add_ttft) worked for me. It is slightly different that yours, perhaps have a look at it and consider some of these changes. @vblagoje...
> @LastRemote As we are going to deprecate all generators in the near future let's focus on supporting this feature in OpenAIChatGenerator only. 🙏 Sure thing, we can focus on...
> > > @LastRemote As we are going to deprecate all generators in the near future let's focus on supporting this feature in OpenAIChatGenerator only. 🙏 > > > >...
Hey @vblagoje, can I ask for an update on the PR status? Trying to keep things moving while I am still happy to discuss more about the future deprecation of...
> > Hey @vblagoje, can I ask for an update on the PR status? Trying to keep things moving while I am still happy to discuss more about the future...
Awesome, thanks! Any additional comments for the current code change? I described my intention of the current changes in a previous post. I will create a PR on the langfuse...