Bohan Qu

Results 39 comments of Bohan Qu

Update: I think we can conclude that reasoning tokens will not contain tool call/tool call result information, at least not in the standard/current way. I have found some research projects...

> it makes sense to perhaps add a property reasoning_text etc to ChatMessage I totally agree. This is actually what I am doing right now, adding a new field `_reasoning_content:...

I created an untested draft PR to illustrate the purposed changes. I will be away for the rest of the week, but feel free to take over.

Update: Claude 3.7 supports reasoning, in a non-standard way. https://docs.anthropic.com/en/docs/build-with-claude/extended-thinking#understanding-thinking-blocks

> Ok @LastRemote regarding streaming response this [approach](https://github.com/deepset-ai/haystack/compare/main...add_ttft) worked for me. It is slightly different that yours, perhaps have a look at it and consider some of these changes. @vblagoje...

> @LastRemote As we are going to deprecate all generators in the near future let's focus on supporting this feature in OpenAIChatGenerator only. 🙏 Sure thing, we can focus on...

> > > @LastRemote As we are going to deprecate all generators in the near future let's focus on supporting this feature in OpenAIChatGenerator only. 🙏 > > > >...

Hey @vblagoje, can I ask for an update on the PR status? Trying to keep things moving while I am still happy to discuss more about the future deprecation of...

> > Hey @vblagoje, can I ask for an update on the PR status? Trying to keep things moving while I am still happy to discuss more about the future...

Awesome, thanks! Any additional comments for the current code change? I described my intention of the current changes in a previous post. I will create a PR on the langfuse...