Corentin Meyer

Results 64 comments of Corentin Meyer

![image](https://github.com/user-attachments/assets/901873aa-648d-4194-baa8-779ca883b63d) My PATH variable (puting `.cargo\bin` on top doesn't change anything)

> Is there no plan for implementing multi-turn conversation natively in DSPy? For any kind of chatbot, being able to pass chat history is necessary. Of course you can pass...

> > Do you have any news about this Chat history feature ? What did you end up doing ? > > If you're asking me, I decided not to...

> I've searched through issues in this repository but I couldn't find anything concrete. What's the progress/roadmap for this command? The only time I've seen it mentioned is in the...

**MORE INFO:** This issue is **NOT** happening when we don't use `dspy.streamify`. This is working: ```python @app.post("/predict") def predict(): # stream = dspy_streamer(question="What is 9362158 divided by the year of...

**MORE INFO:** The issue is still happening when converting FastAPI endpoint to an async endpoint with streaming. So it's not related to FastAPI sync/async ```python dspy_streamer = dspy.asyncify(dspy_streamer) @app.post("/predict") async...

**MORE INFO:** Thie issue is **NOT** happening when using OpenAI provider by replace the LM by: ```python dspy.configure( lm=dspy.LM('openai/gpt-4o-mini', api_key="xxxxx", cache=False, ) ) ```

**To sum-up:** ❌ FastAPI + Bedrock + dspy.streamify ✅ FastAPI + OpenAI + dspy.streamify ✅ FastAPI + Bedrock (without streaming) ✅ Bedrock + dspy.streamify (simple script without API)

AI Generated Monkey-Patch that solved my issue: ```python from typing import Any def fixed_merge_usage_entries(self, usage_entry1, usage_entry2) -> dict[str, dict[str, Any]]: if usage_entry1 is None or len(usage_entry1) == 0: return dict(usage_entry2)...

> [@lambda-science](https://github.com/lambda-science) Is this fully working for you now? I have a DSPy application served by FastAPI and I get full usage when using sync non-streaming modules, but if I...