Agent skill · Backend & API

jetson-speculative-decoding

Add EAGLE-3 or draft-model speculative decoding to a Jetson vLLM server when TPOT is the bottleneck.

NVIDIAgithub.com/NVIDIAGitHub ↗
claude-codecodexApache-2.0
Install
npx skills add NVIDIA/skills --skill jetson-speculative-decoding --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 5
SKILL.md size: 5 KB
Bundled scripts: none
Version: 0.0.1
Declared author: Jetson Team
Path: skills/jetson-speculative-decoding/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 2,789
Language: Python
Read our review of the source →

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# Jetson Speculative Decoding (vLLM) Speculative decoding lets a small "draft" model propose tokens that the target model verifies in a single forward pass, reducing per-token latency. On Jetson, the win/loss is **dominated by VRAM headroom**, not by the draft quality. This skill encodes the parts an LLM won't already know. ## Purpose Tune an existing Jetson vLLM deployment for faster token genera

More from skills
All skills →
About this skill
What does the jetson-speculative-decoding skill do?

Add EAGLE-3 or draft-model speculative decoding to a Jetson vLLM server when TPOT is the bottleneck.

How do I install it?

Run `npx skills add NVIDIA/skills --skill jetson-speculative-decoding --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From NVIDIA/skills, a repository with 2,789 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going