Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
The fastest, lightest, and easiest-to-integrate AI gateway on the market. Fully open-sourced.
