HelloStack
LiteLLM logo

LiteLLM

AIOpen Source

Open-Source AI Gateway & LLM Proxy

Starting price
Free
Pricing
Free plan

About LiteLLM

LiteLLM is an open-source AI gateway and LLM proxy built for platform teams managing AI workloads. It sits in front of your AI stack to show who’s using which models, cap spend before it runs, and route each request to the right model, with self-hosted deployment in minutes and no credit card required.

LiteLLM screenshot

Key Features

Platform teams need a single control plane to manage multiple LLMs and prevent runaway costs. LiteLLM provides that with routing, governance, and observability across models and MCPs:

Routing & governance

Route requests to the appropriate model; enforce spend caps before they run; manage access across teams.

Self-hosted deployment

Deploy in minutes on your own infrastructure; data stays in-house; no credit card required.

Model and MCP integrations

Supports OpenAI, Anthropic, Azure, Bedrock, Vertex AI, Mistral, and more; MCPs like Jira, Atlassian, GitHub, GitLab for governance.

Observability & optimization

Monitor usage, latency, and errors; adjust routing to reduce costs and improve response times.

Summary

Best for platform engineering, security/compliance-focused ops, and teams shipping AI at scale.

Pricing

View pricing

Plans and prices as listed on litellm.ai as of Sep 18, 2026.

Open Source

$0 / Free forever · self-hosted

  • 100+ providers, one OpenAI API
  • Virtual keys, users & teams
  • Spend tracking
  • Budgets + rate limits
  • LLM fallbacks
  • Request/response logging
  • Prometheus metrics

Enterprise

Talk to sales / Annual

  • Everything in Open Source, plus:
  • SSO + SCIM
  • OIDC / JWT auth
  • Audit logs
  • Secret managers + key rotation
  • Org & team admins
  • Multi-region control plane
  • 24/7 support & SLAs
  • Dedicated support & onboarding
  • Annual request capacity + volume discounts
  • Self-hosted · air-gap available

Alternatives to LiteLLM

See all →
Helicone logo
Helicone

AI Gateway & LLM Observability

OpenRouter logo
OpenRouter

The Unified Interface For Every Model

Portkey logo
Portkey

Production Stack for Gen AI Builders

The company behind LiteLLM

Founded
2023
Headquarters
San Francisco, United States
Employees
11–50
Website
litellm.ai
Social
@litellmLinkedIn