runtime-skills
Universal Runtime best practices for PyTorch inference, Transformers models, and FastAPI serving. Covers device management, model loading, memory optimization, and performance tuning.
npx skills add majiayu000/claude-skill-registry --skill runtime-skills-llama-farm-llamafarm-4bef3f4b --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Universal Runtime Skills Best practices and code review checklists for the Universal Runtime - LlamaFarm's local ML inference server. ## Overview The Universal Runtime provides OpenAI-compatible endpoints for HuggingFace models: - Text generation (Causal LMs: GPT, Llama, Mistral, Qwen) - Text embeddings (BERT, sentence-transformers, ModernBERT) - Classification, NER, and reranking - OCR and document understanding - Anomaly detection **Directory**: `runtimes/universal/` **Python**: 3.11+ **Key Dependencies**: PyTorch, Transformers, FastAPI, llama-cpp-python ## Links to Shared Skills This skill extends the shared Python practices. Always apply these first: | Topic | File | Priority | |-------|------|----------| | Patterns | [python-skills/patterns.md](../python-skills/patterns.md) | Medium | | Async | [python-skills/async.md](../python-skills/async.md) | High | | Typing | [python-skills/typing.md](../python-skills/typing.md) | Medium | | Testing | [python-skills/testing.md](../python-skills/testing.md) | Medium | | Errors | [python-skills/error-handling.md](../python-skills/error-handling.md) | High | | Security | [python-skills/security.md](../python-skills/security.md) | Critical
- Overview
- Links to Shared Skills
- Runtime-Specific Checklists
- Architecture
- Key Patterns
- 1. Model Loading with Double-Checked Locking
- 2. Device-Aware Tensor Operations
- 3. TTL-Based Model Caching
- 4. Async Generation with Thread Pools
- Review Priority
What does the runtime-skills skill do?
Universal Runtime best practices for PyTorch inference, Transformers models, and FastAPI serving. Covers device management, model loading, memory optimization, and performance tuning.
How do I install it?
Run `npx skills add majiayu000/claude-skill-registry --skill runtime-skills-llama-farm-llamafarm-4bef3f4b --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From majiayu000/claude-skill-registry, a repository with 534 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.