Model Manager
Test, validate, and add new AI models to the eval suite. Use when user asks to add new models, test model access, check pricing, or update models.yml.
npx skills add majiayu000/claude-skill-registry --skill model-manager --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Model Manager Test API access, validate configurations, and add new AI models to the AILANG eval suite. ## Quick Start **Most common usage:** ```bash # User says: "Can we add GPT-5.1 to the eval suite?" # This skill will: # 1. Test API access to GPT-5.1 # 2. Find the correct API model name # 3. Look up pricing information # 4. Update models.yml configuration # 5. Run a test benchmark to verify ``` ## When to Use This Skill Invoke this skill when: - User asks to "add a new model" to eval suite - User mentions checking if a model is "accessible" or "available" - User wants to "test API access" to a model - User asks to "update models.yml" or "check pricing" - User says "can we use [model name]?" for evaluations ## Available Scripts ### `scripts/test_model_access.sh <provider> <model-name>` Test API access to a model and display authentication status. **Usage:** ```bash # Test OpenAI model scripts/test_model_access.sh openai gpt-5.1 # Test Anthropic model scripts/test_model_access.sh anthropic claude-sonnet-4-5-20250929 # Test Google Gemini via Vertex AI scripts/test_model_access.sh google gemini-3-pro-preview-11-2025 ``` **Output:** ``` Testing: openai/gpt-5.1 ✓ OPENAI_API_KEY foun
- Quick Start
- When to Use This Skill
- Available Scripts
- scripts/testmodelaccess.sh <provider> <model-name>
- scripts/findmodelinfo.sh <model-keywords>
- scripts/verifyvertexmodel.sh <model-name>
- scripts/runtestbenchmark.sh <model-name>
- Workflow
- 1. Test API Access
- 2. Find Model Information
- 3. Update models.yml
- 4. Run Test Benchmark
- 5. Document the Model
- 6. Optional: Run Full Eval
User says: "Can we add GPT-5.1 to the eval suite?" This skill will: Test OpenAI model scripts/test_model_access.sh openai gpt-5.1 Test Anthropic model scripts/test_model_access.sh anthropic claude-sonnet-4-5-20250929 Test Google Gemini via Vertex AI scripts/test_model_access.sh google gemini-3-pro-preview-11-2025 Find GPT-5.1 info scripts/find_model_info.sh "GPT-5.1 API model name pricing"
What does the Model Manager skill do?
Test, validate, and add new AI models to the eval suite. Use when user asks to add new models, test model access, check pricing, or update models.yml.
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill model-manager --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.