LiteLLM vs Helicone
Both are alternatives to Portkey. Here's how they stack up — verified facts, no spin.
Also searched as Helicone vs LiteLLM — same comparison, one verdict.
LiteLLM and Helicone are closely matched on ownership (90 vs 88) — this one comes down to pricing and to which trade-offs below you can live with.
LiteLLM
TOP PICKOne OpenAI-compatible API in front of 100+ providers, running on your own box.
LiteLLM is the de facto open gateway for this layer: a proxy that exposes an OpenAI-compatible endpoint in front of 100+ providers, with virtual keys, per-team budgets, rate limits, fallbacks and logging. You run it, so prompts never leave your infrastructure and there is zero markup on token spend — you pay the model providers directly. At 55k GitHub stars with commits landing daily it is the most widely adopted option here. Licensing is worth reading precisely: the core is MIT, while everything under the repository's enterprise/ directory carries a separate commercial licence.
Helicone
Apache-2.0 gateway in Rust, with observability built in rather than bolted on.
Helicone is an open-source AI gateway written in Rust, with logging, caching and cost tracking built into the routing layer rather than added alongside it — which is the practical difference from LiteLLM, where observability is thin and usually paired with something else. It is Apache-2.0 throughout, self-hostable, and also offered as a hosted service with a free tier. For teams who want one component instead of two, it is the tidier answer.
Side by side
10 points of comparison, every one read from a verified field. Green marks the side that wins a row outright. A dash means we do not hold that fact — never that it is zero.
| LiteLLM | Helicone | |
|---|---|---|
| Sovereignty ScoreOur transparent 0–100 composite for data ownership and exit cost. | 90 | 88 |
| Open source | Yes | Yes |
| Self-hostable | Yes | Yes |
| Local-first data | Yes | Yes |
| License | MIT (core); enterprise/ directory under a separate commercial licence | Apache-2.0 |
| Pricing | Free and self-hosted — you pay the model providers directly with no markup, plus hosting for a small VM (roughly $20–50/month). A paid enterprise tier exists for SSO, audit logs and support. | Free and self-hostable under Apache-2.0. The hosted service has a free tier of roughly 10,000 requests per month, with paid plans starting around $79/month. |
| RAM to run it wellThe figure that actually matters, not the vendor's minimum. | 2 GB | — |
| Realistic running costWhat the box costs each month if you run it yourself. | $12–24/mo, against LLM gateway products charging per request | — |
| Setup timeHonest first-install estimate, not the marketing quickstart. | 1 hour | — |
| Ongoing maintenanceThe part nobody budgets for. | Low, but it is now in the path of every model call you make. | — |
LiteLLM is Macrostack's recommended Portkey alternative, so it's our pick here.
LiteLLM
Strengths
- +Zero markup — provider tokens are billed to you at cost
- +Prompts and completions never leave your infrastructure
- +Virtual keys, per-team budgets and rate limits built in
- +100+ providers behind one OpenAI-compatible endpoint; 55k stars, daily commits
Trade-offs
- −You run it: deployment, upgrades, monitoring and uptime are yours
- −Observability is basic out of the box — expect to pair it with a tracing tool
- −The MIT core stops at the enterprise/ directory; SSO and audit logging sit behind a commercial licence
- −A proxy you operate is another production dependency to keep healthy
Helicone
Strengths
- +Apache-2.0 with no enterprise-directory carve-out
- +Routing and observability in one component — less to assemble
- +Written in Rust; low latency overhead for a proxy
- +Hosted option with a real free tier if you would rather not run it
Trade-offs
- −Smaller project and community than LiteLLM (about 6k stars)
- −Fewer providers supported than LiteLLM's 100+
- −The hosted tier means prompts transit a third party — the thing self-hosting avoided
- −Less mature budget and virtual-key tooling than LiteLLM
Which one fits you
The trade-offs above, turned into a decision. Find the line that describes your team.
Choose LiteLLM
if a lower exit cost matters more to you than any single feature, and zero markup — provider tokens are billed to you at cost.
Choose Helicone
if apache-2.0 with no enterprise-directory carve-out.
Neither, yet
if both carry a real cost you should weigh first — you run it: deployment, upgrades, monitoring and uptime are yours, and smaller project and community than LiteLLM (about 6k stars). If either of those is a dealbreaker for your team, the shortlist is wrong rather than the choice.
What it takes to run these yourself
Real requirements and honest running costs, not the vendor quickstart.
LiteLLM vs Helicone — common questions
Is LiteLLM a better fit than Helicone for llm gateways & routing?
It depends on what you are optimising for, and the honest split is this: LiteLLM scores 90 to Helicone's 88 on data ownership and exit cost, so it is the safer choice if you care about being able to leave. Helicone earns its place on a different axis — apache-2.0 with no enterprise-directory carve-out. Neither is a wrong answer for every team; the table above is the actual comparison.
What happens if we want to switch later?
LiteLLM keeps its data local or in open formats, so leaving is an export rather than a negotiation. Helicone is still self-hostable, so the files stay on your server either way — but it is not local-first by design, so check what its export produces before you rely on it.
Can I self-host LiteLLM or Helicone?
Both can be self-hosted. The difference is what it costs you in time rather than whether it is possible — see the setup and maintenance rows above.
Are LiteLLM and Helicone both alternatives to Portkey?
Yes — both appear in our Portkey comparison, which is why they are worth putting side by side. People usually arrive here already having decided to move off Portkey and now choosing between the two replacements, which is a narrower and much easier question.
Related alternative guides
Facts verified 2026-07-30. Licenses and pricing change — spotted something out of date? That's a correction we want.