Agent skill · DevOps & Cloud

tao-run-inference-service

Start, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice) by delegating container execution to the appropriate platform skill. Handles container image resolution, job-payload JSON construction, and the service registry. Use when the user wants to run inference on a TAO model checkpoint using a microservice container, deploy a TAO inference endpoint, or stop a running inference container.

NVIDIAgithub.com/NVIDIAGitHub ↗
claude-codecodexcan modify filesApache-2.0
Install
npx skills add NVIDIA/skills --skill tao-run-inference-service --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 11
SKILL.md size: 18 KB
Bundled scripts: none
Version: 0.1.0
Declared author: NVIDIA Corporation
Allowed tools: ReadBashWrite
Requires: The inference service has no cloud-storage dependency — model weights come from the HuggingFace Hub (HF_TOKEN env var…
Path: skills/tao-run-inference-service/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 2,789
Language: Python
Read our review of the source →

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# TAO Inference Microservice ## Instructions **To start an inference service:** 1. Collect required inputs (Section 1) and resolve the container image (Section 2). 2. Build the job payload and inner command (Sections 3–4.1); use `references/code-templates.yaml` → `job_payload_builder`. 3. Read `skills/platform/<platform>/SKILL.md` and start the container (Section 4.2). 4. Write the service registr

More from skills
All skills →
About this skill
What does the tao-run-inference-service skill do?

Start, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice) by delegating container execution to the appropriate platform skill. Handles container image resolution, job-payload JSON construction, and the service registry. Use when the user wants to run inference on a TAO model checkpoint using a microservice container, deploy a TAO inference endpoint, or stop a running inference container.

How do I install it?

Run `npx skills add NVIDIA/skills --skill tao-run-inference-service --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From NVIDIA/skills, a repository with 2,789 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going