The two most popular self-hosted LLM proxies. Same job, very different architecture.
LiteLLM is the most popular open-source LLM proxy with 41.6k GitHub stars and YC backing. It supports 100+ providers and has the largest community in this space.
Stockyard is a single Go binary with embedded SQLite. It ships the proxy, observability, audit trail, and 164+ tools in one process. No Postgres, no Redis, no Docker Compose.
Both are legitimate choices. The right one depends on your infrastructure preferences and what you already run.
| Feature | Stockyard | LiteLLM |
|---|---|---|
| Language | Go (compiled binary) | Python |
| Deployment | Single ~25MB binary | Docker: Postgres + Redis required |
| External deps | None (embedded SQLite) | Postgres (required) + Redis (required) |
| Min resources | Runs on anything | 4 CPU / 8GB RAM recommended |
| Open source | Proxy: Apache 2.0 / Platform: BSL 1.1 | MIT (41.6k stars) |
| Providers | 40+ | 100+ |
| Pricing | Free unlimited, paid from $7.99/mo per bundle per tool, or $29.99/mo All Tools bundle | Free self-hosted, Enterprise contact sales |
| Cost tracking | ✓ Per-request | ✓ Per-request |
| Caching | ✓ Built-in | ✓ Via Redis |
| Rate limiting | ✓ Built-in | ✓ RPM/TPM limits |
| Failover | ✓ Built-in | ✓ Load balancing |
| Guardrails | ✓ 76 middleware modules | ✓ Via integrations |
| Observability | ✓ Built-in (Lookout) | Via Langfuse/Arize integration |
| Audit trail | ✓ Hash-chained | Logs (Enterprise) |
| Red-team testing | ✓ Feral | None |
| Supply chain | Compiled Go binary | PyPI (supply chain attack March 24, 2026) |
Data reflects publicly available documentation as of March 2026.
Zero infrastructure. You do not need Postgres, Redis, or Docker. Download one file, set an environment variable, and you have a working proxy with tracing.
Supply chain security. Stockyard is a compiled Go binary. In March 2026, LiteLLM had a PyPI supply chain attack where malicious versions (v1.82.7 and v1.82.8) stole credentials. A compiled binary eliminates that attack surface entirely.
Built-in observability. LiteLLM requires integrating with Langfuse or Arize for tracing. Stockyard includes Lookout, a full observability dashboard, in the same binary.
Cryptographic audit trail. Stockyard's Brand app creates a SHA-256 hash-chained ledger of every LLM request. LiteLLM has no equivalent.
If you need 100+ providers, LiteLLM wins. Stockyard supports 40+, which covers all major providers, but LiteLLM's coverage is broader for niche or regional providers.
If your team is Python-native and you already run Postgres, LiteLLM integrates more naturally into your stack. The ecosystem is also significantly larger (41.6k stars, extensive documentation, active Discord).
If you want a fully MIT-licensed solution with no BSL components, LiteLLM is the cleaner licensing story. Stockyard's proxy core is Apache 2.0, but the full platform is BSL 1.1.
LiteLLM has more providers and a bigger community. Stockyard has simpler deployment and more built-in features. If you already run Postgres, LiteLLM is a natural fit. If you want everything in one binary with zero dependencies, try Stockyard.