TokHub is an open-source monitoring, recommendation, and OpenAI-compatible gateway system for AI API intermediaries. It combines public monitoring, user workspaces, governance, and Docker self-hosting with layered probing and health scoring.
Collecting history — the radar snapshots this repo daily. The trend line appears after 3 days of data (1 so far).
What it is
TokHub is an open-source monitoring, recommendation operations, and OpenAI-compatible gateway system for AI API intermediaries. It consolidates public status pages, supplier rankings, user workspaces, platform admin backend, layered probing, usage metering, alerts and auditing, key encryption, and Docker self-hosted deployment.
How it works
The project implements multi-layer health checks (L1 connectivity, L2 model availability, L3 real generation) and a gateway routing algorithm that selects upstreams based on latency, success, or cost, with Redis-backed routing state and QPS bucketing. It provides an OpenAI-compatible gateway exposing /gateway/v1/* and supports multiple upstreams per gateway. It includes a dedicated admin backend for channels, users, organizations, and Open API sites, plus data models for channels, credentials, models, probes, incidents, and usage.
Getting started
cp -n .env.example .env || true
docker compose up -d --build
Default endpoints and credentials:
- Web / API / Gateway: http://localhost:8080
- OpenAPI: http://localhost:8080/openapi.yaml
- Metrics: http://localhost:8080/metrics
- Gateway: http://localhost:8080/gateway/v1/*
- Local dev admin: admin
- Local dev password: admin@tokhub.local
Smokes after start:
```bash
TOKHUB_BASE_URL=http://localhost:8080 npm run test:smoke
Additional checks and release procedures are documented in the repository under deployment and test scripts.
Getting started (continued) / Local acceptance
go test ./...
go vet ./...
sqlc generate
npm run typecheck
npm run lint
npm run build
npm run test:security
Operational tests follow with various npm and deploy scripts, including release checks.
Recent releases
- none
Traction
177 stars, 16 forks, 0 open issues
License
Apache-2.0