MFed
MFed
Was surprised to see this didn't work when I moved to code-server. Would be a really useful feature.
I would also like to be able to cancel streams gracefully from the python client.
I also really need this feature to go to production using crewAI. I would like to store this information in a separate data store. Ideally I would be able to...
I also want to be able to stream live output to a frontend. Seems like it is also related to https://github.com/joaomdmoura/crewAI/issues/146
Yeah so for instance I want to be able to use prompt caching. https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching. To turn on that beta feature you need to include a special header: ![Screenshot 2024-12-12 at...
We frequently change models and providers with all of the parts of our app which are interacting with LLMs. So for instance I may have a piece of code which...