Gateways & LLM Routing
OpenAI-compatible gateways, routers, guardrail firewalls and free-LLM aggregators.
6 projects · catalog last checked 2026-10-20. "Highlight" is editorial; status, commit and release come from the weekly evidence refresh.
Comparison
| Project | What it does | Highlight (editorial) | Deployment | Hardware | Licence | Status |
|---|---|---|---|---|---|---|
| FreeLLMAPI | Aggregates free LLM providers behind one /v1 endpoint with failover | Free-tier aggregation | self-hosted | cpu-ok | MIT | active |
| OpenCode Free Router | Routes coding-agent traffic to free model endpoints | Free routing for coding agents | self-hosted | cpu-ok | MIT | active |
| Bifrost | High-performance AI gateway with load balancing and fallbacks | Low-latency gateway | self-hosted | cpu-ok | Apache-2.0 | active |
| Trylon Gateway | Self-hosted LLM firewall with guardrails | Guardrails / security | self-hosted | cpu-ok | BUSL-1.1 ⚠ needs review | active |
| LiteLLM | Proxy + SDK for 100+ LLM APIs in OpenAI format, cost tracking | Broadest provider coverage | self-hosted | cpu-ok | MIT (enterprise/ dir separate) ⚠ needs review | active |
| Portkey Gateway | Fast AI gateway with routing, retries and caching | Edge-friendly gateway | self-hosted | cpu-ok | MIT | active |
Quick start
pip install 'litellm[proxy]'
litellm --model ollama/llama3.2 --port 4000
curl http://localhost:4000/v1/models
http://localhost:4000/v1.
Project details
FreeLLMAPI
Aggregates free LLM providers behind one /v1 endpoint with failover
| Upstream repository | FreeLLMAPI on GitHub |
| Setup docs | FreeLLMAPI setup guide |
| Licence | MIT · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | MIT |
| Repository state | active |
| Licence review reason | – |
| Last lookup | ok |
| Last commit | 2026-10-20 |
| Latest release | v0.16.6 (2026-10-20) |
| Deployment | self-hosted |
| Hardware | cpu-ok |
| Languages | TypeScript |
| Evidence collected | 2026-10-20 |
OpenCode Free Router
Routes coding-agent traffic to free model endpoints
| Upstream repository | OpenCode Free Router on GitHub |
| Setup docs | OpenCode Free Router setup guide |
| Licence | MIT · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | MIT |
| Repository state | active |
| Licence review reason | – |
| Last lookup | ok |
| Last commit | 2026-10-17 |
| Latest release | none detected |
| Deployment | self-hosted |
| Hardware | cpu-ok |
| Languages | JavaScript |
| Evidence collected | 2026-10-20 |
Bifrost
High-performance AI gateway with load balancing and fallbacks
| Upstream repository | Bifrost on GitHub |
| Setup docs | Bifrost setup guide |
| Licence | Apache-2.0 · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | Apache-2.0 |
| Repository state | active |
| Licence review reason | – |
| Last lookup | ok |
| Last commit | 2026-10-19 |
| Latest release | ent-v2.3.1-base (2026-10-19) |
| Deployment | self-hosted |
| Hardware | cpu-ok |
| Languages | Go |
| Evidence collected | 2026-10-20 |
Trylon Gateway
Self-hosted LLM firewall with guardrails
| Upstream repository | Trylon Gateway on GitHub |
| Setup docs | Trylon Gateway setup guide |
| Licence | BUSL-1.1 ⚠ needs review · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | NOASSERTION |
| Repository state | active |
| Licence review reason | Source-available, not OSI: Business Source License 1.1 with a use limitation (upstream LICENSE). |
| Last lookup | ok |
| Last commit | 2025-06-25 |
| Latest release | none detected |
| Deployment | self-hosted |
| Hardware | cpu-ok |
| Languages | Python |
| Evidence collected | 2026-10-20 |
LiteLLM
Proxy + SDK for 100+ LLM APIs in OpenAI format, cost tracking
| Upstream repository | LiteLLM on GitHub |
| Setup docs | LiteLLM setup guide |
| Licence | MIT (enterprise/ dir separate) ⚠ needs review · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | NOASSERTION |
| Repository state | active |
| Licence review reason | Multiple licences: MIT for most code, separate licence for the enterprise/ directory (stated at top of upstream LICENSE). |
| Last lookup | ok |
| Last commit | 2026-10-20 |
| Latest release | v1.106.1 (2026-10-20) |
| Deployment | self-hosted |
| Hardware | cpu-ok |
| Languages | Python |
| Evidence collected | 2026-10-20 |
Portkey Gateway
Fast AI gateway with routing, retries and caching
| Upstream repository | Portkey Gateway on GitHub |
| Setup docs | Portkey Gateway setup guide |
| Licence | MIT · licence evidence · checked 2026-10-20 |
| Licence detected by GitHub | MIT |
| Repository state | active |
| Licence review reason | – |
| Last lookup | ok |
| Last commit | 2026-05-25 |
| Latest release | v1.15.2 (2026-01-12) |
| Deployment | self-hosted |
| Hardware | cpu-ok |
| Languages | TypeScript |
| Evidence collected | 2026-10-20 |