Bohan Qu

Results 39 comments of Bohan Qu

Previous PR: #7442 . I devided to make a new one since this should not be considered a fix anymore.

> This is actually intended. > > We made the decision to make all `PromptBuilder` inputs as optional to support some use cases like self correcting loops in a Pipeline....

> This is a valid requests I'd say, I would keep the current behaviour and add a flag that makes the inputs non optional. Feel free to update the PR...

I decided to open a new PR since it is no longer a fix: https://github.com/deepset-ai/haystack/pull/7553

Hi @silvanocerza , do you mind sharing more about the broader vision for `ChatMessage`? Besides the multimodal support discussed here, I've noticed [some recent updates related to tool calls](https://github.com/deepset-ai/haystack-experimental/blob/main/haystack_experimental/dataclasses/chat_message.py) in...

I am planning to add multimodal support in haystack-experimental (it already has some advanced tool supports there). I am opening an issue for this (basically my to-do list for better...

> have you used o1 via API? Unfortunately no, I do not have access. But according to [the documentation](https://platform.openai.com/docs/guides/reasoning#limitations), o1 does not support streaming, and the reasoning tokens are not...

Here is a collection of APIs that support reasoning models (feel free to add more): GPT-o1: Reasoning tokens not included in response body DeepSeek-r1 (official): https://api-docs.deepseek.com/guides/reasoning_model (use `reasoning_content` for reasoning...

> I have not yet seen a stable schema on how reasoning tokens are included in the api response as openai does not return them. I agree it's a bit...

@vblagoje If there are no other suggestions regarding the purposal, would you mind me creating a draft PR? I believe this is worth assigning a higher priority and a draft...