Max Krueger
Max Krueger
https://github.com/zilliztech/GPTCache/blob/main/docs/usage.md#Use-GPTCache-server
- Onboard chat and chat streaming for fireworks.ai Ref: - https://readme.fireworks.ai/docs/quickstart - https://github.com/langchain-ai/langchain/blob/master/libs/partners/fireworks/langchain_fireworks/chat_models.py
User should be able to pass override parameters in the chat request body.
Provider to support calling GCP Vertex Chat Models
### What Happened? ## Issue Description The gateway fails to properly parse error messages when accessing Claude models on GCP Vertex AI via the streaming endpoint. The issue occurs when...