Rohit Agarwal
Rohit Agarwal
Add Predibase as an AI provider integration. They allow easy use of adapters
**Streaming `run` functions for Assistants API** - Created a new route for creating thread runs: `POST /threads/runs/stream` that automatically polls in the background and streams run steps and messages to...
I'd love to start a version that integrates with ChatGPT and builds on categories of reasons rather picking one from a group. I've felt these scripts have been more useful...
This improves response time metrics for streaming and cache use cases, without retries.
# Add metadata to HookSpanContext and webhook plugin ## Changes This pull request introduces the following changes to the AI gateway repo: 1. Added metadata to the HookSpanContext, which is...
**Adding explanations to the data property of default guardrail plugins** We're adding a `data.explanation` property to default guardrails to make it easier to identify why they succeeded or failed.
  **Title:** Allow hook based logs ### 🔄 What Changed - Added a new `log` property to the `GuardrailCheckResult` interface - Modified the hooks manager to include...
  **Title:** Add request, response log for the Portkey PII plugin to the main request trace ### 🔄 What Changed - Added new interfaces for structured logging...
## Description Cleaning up handlerUtils in preparation to add more features here. ## Type of Change - [ ] Bug fix (non-breaking change which fixes an issue) - [ ]...