multi-tenant-llm-hosting
Design secure, multi-tenant LLM hosting platforms with tenant isolation, quotas, billing attribution, noisy-neighbor protection, and per-tenant policy controls.
npx skills add majiayu000/claude-skill-registry --skill multi-tenant-llm-hosting --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Multi-Tenant LLM Hosting Host many teams/customers on shared inference infrastructure without sacrificing security, performance, or cost governance. ## Isolation Model - Strong tenant identity on every request - Per-tenant API keys and scoped model access - Namespace or workload isolation for high-risk tenants - Strict data retention and log partitioning controls ## Noisy-Neighbor Controls - Per-tenant RPM/TPM limits - Concurrency caps and queue isolation - Fair scheduling with weighted priority classes - Backpressure and graceful degradation policies ## Billing and Chargeback Track per-tenant: - prompt/completion/cached tokens, - model type and route, - latency and success rate, - cost with markup or internal transfer pricing. ## Security Baseline - Encrypt data in transit and at rest. - Disallow cross-tenant cache leakage. - Restrict debug data access by role. - Audit all privileged administrative actions. ## Operational Runbook 1. Onboard tenant with policy template. 2. Issue virtual key and quota profile. 3. Validate observability and billing tags. 4. Run tenant-specific load/safety tests. 5. Enable production traffic with canary limits. ## Related Skills - [llm-gateway](../.
- Isolation Model
- Noisy-Neighbor Controls
- Billing and Chargeback
- Security Baseline
- Operational Runbook
- Related Skills
What does the multi-tenant-llm-hosting skill do?
Design secure, multi-tenant LLM hosting platforms with tenant isolation, quotas, billing attribution, noisy-neighbor protection, and per-tenant policy controls.
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill multi-tenant-llm-hosting --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.