llm-gateway
6 个已发布仓库。
| 仓库 | |||||
|---|---|---|---|---|---|
| 1 |
cheaper-inference/OmniRoute
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
|
88k | +0.4% | +2.5% | 319 |
| 2 |
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
|
63.3k | +0.1% | +0.6% | 52 |
| 3 |
QuantumNous/new-api
Open-source AI gateway. Self-hosted LLM gateway with OpenAI-, Claude- and Gemini-compatible APIs, model routing, access control, usage tracking and cost accounting.
|
52k | +0.1% | +0.8% | 47 |
| 4 |
Kong/kong
🦍 The API and AI Gateway
|
44.4k | +0.0% | +0.0% | 10 |
| 5 |
langfuse/langfuse
🪢 Open source AI engineering platform: AI Gateway, agent observability, evals, and prompt/skill management, built on OpenTelemetry. One open platform for every AI call and every agent. Self-host or use Langfuse Cloud.
|
37.5k | +0.1% | +0.8% | 29 |
| 6 |
decolua/9router
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
|
32.5k | +0.1% | +1.1% | 103 |