LiteLLM
The open gateway most teams run: 100+ providers, your keys, no fee on spend.
A proxy with an OpenAI-compatible endpoint in front of 100+ providers, with virtual keys, per-team budgets and fallbacks. You run it and pay the providers directly, so nothing is added to your token spend. GitHub showed 63,375 stars and a push on 17 Nov 2026. The core is MIT; the enterprise/ directory is under a separate commercial licence.
Strengths
- +No fee on token spend: providers bill you at their own price
- +Prompts never leave your infrastructure
- +Virtual keys, per-team budgets and fallbacks built in
Trade-offs
- −You run it: deployment, upgrades and uptime are yours
- −SSO and audit logs sit behind the commercial licence