Bifrost is a Go-based enterprise AI gateway that unifies access to multiple providers via a single OpenAI-compatible API, with features like adaptive load balancing, clustering, guardrails, and observability. It emphasizes zero-config startup, multi-provider support, and enterprise governance.
Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).
What it is
Bifrost is a high-performance AI gateway that unifies access to 23+ providers through a single OpenAI-compatible API, offering features such as automatic fallbacks, load balancing, semantic caching, MCP integration, and enterprise-grade capabilities.
How it works
The gateway provides a unified interface for multiple AI providers, with options for multi-provider configuration, adaptive load balancing, and governance. It supports MCP for external tool calls, semantic caching to reduce latency, and observability features including Prometheus metrics and distributed tracing. The architecture is modular with components for core functionality, providers, transports, UI, and plugins.
Getting started
Gateway (HTTP API)
# NPX - Get started in 30 seconds
npx -y @maximhq/bifrost
# Docker - Production ready
docker run -p 8080:8080 -v $(pwd)/data:/app/data maximhq/bifrost
Go SDK
go get github.com/maximhq/bifrost/core
Drop-in Replacement
# OpenAI SDK
- base_url = "https://api.openai.com"
+ base_url = "http://localhost:8080/openai"
Learn More
Gateway Setup: https://docs.getbifrost.ai/quickstart/gateway/setting-up Go SDK Guide: https://docs.getbifrost.ai/quickstart/go-sdk/setting-up
Recent releases
- transports/v1.6.8 Bifrost HTTP v1.6.8 (2026-08-05): Features include WebSocket Proxy Support for routing through provider-level proxies.
- plugins/telemetry/v1.5.33: Plugin telemetry v1.5.33 (2026-08-05); chore: upgraded core to v1.7.6 and framework to v1.5.6
- plugins/semanticcache/v1.5.33: Plugin semanticcache v1.5.33 (2026-08-05); chore: upgraded core to v1.7.6 and framework to v1.5.6
- plugins/prompts/v1.0.33: Plugin prompts v1.0.33 (2026-08-05); chore: upgraded core to v1.7.6 and framework to v1.5.6
- plugins/otel/v1.4.5: Plugin otel v1.4.5 (2026-08-05); chore: upgraded core to v1.7.6 and framework to v1.5.6
Installation snippets
Each plugin release includes an installation snippet:
# Update your go.mod to use the new plugin version
go get github.com/maximhq/b
# Update your go.mod to use the new plugin version
go get github.com/maximhq/bif
# Update your go.mod to use the new plugin version
go get github.com/maximhq/bifrost
Traction
Stars: 7042. Forks: 991. Open issues: 808.
Behind the repo
Not provided in the README excerpt.
Caveats
License: Apache-2.0. Created: 2025-03-19. Last push: 2026-08-04.