llm-proxy topic

List llm-proxy repositories

prompt_sail

46
Stars
0
Forks
Watchers

Open Source LLM proxy that transparently captures and logs all interactions with LLM API

olla

119
Stars
12
Forks
119
Watchers

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

plano

4.7k
Stars
263
Forks
4.7k
Watchers

Ship agents faster. Plano is delivery infrastructure for agentic applications. A models-native proxy server & dataplane that offloads the plumbing work, so you stay focused on product logic.

llm-mux

232
Stars
72
Forks
232
Watchers

AI Gateway: Claude Pro, Copilot, Gemini subscriptions → OpenAI/Anthropic/Gemini APIs. No API keys needed.

ccproxy

126
Stars
18
Forks
126
Watchers

Build mods for Claude Code: Hook any request, modify any response, /model "with-your-custom-model", intelligent model routing using your logic or ours, and even use your Claude subscription as an API

LangRoute

30
Stars
8
Forks
30
Watchers

This is a robust and configurable LLM proxy server built with Node.js, Express, and PostgreSQL. It acts as an intermediary between your applications and various Large Language Model (LLM) providers

LLMApiGateway

21
Stars
3
Forks
21
Watchers

A personal LLM gateway with fault-tolerant capabilities for calls to LLM models from any provider with OpenAI-compatible APIs. Advanced features like retry, model sequencing, and body parameter inject...