Agent skill · Backend & API

huggingface-community-evals

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

Wayner Barrios443★ · 1 repos on radarProfile →
claude-codeships scriptsMIT
Install
npx skills add waybarrios/opencode-power-pack --skill huggingface-community-evals --agent claude-code

Same command for any agent — swap --agent for codex, cursor, copilot.

Facts
Files in the skill folder: 6
SKILL.md size: 7 KB
Bundled scripts: yes
Path: skills/huggingface-community-evals/SKILL.md
Open the folder on GitHub →
Where it comes from
Stars: 443
Language: JavaScript
Read our review of the source →

Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.

From the SKILL.md

# Overview This skill is for **running evaluations against models on the Hugging Face Hub on local hardware**. It covers: - `inspect-ai` with local inference - `lighteval` with local inference - choosing between `vllm`, Hugging Face Transformers, and `accelerate` - smoke tests, task selection, and backend fallback strategy It does **not** cover: - Hugging Face Jobs orchestration - model-card or `m

More from opencode-power-pack
All skills →
hf-cloud-sagemaker-production-defaultsCreate a SageMaker endpoint (real-time or async) with autoscaling, CloudWatch alarms, and tagging…DevOps & Cloudhuggingface-llm-trainerTrain or fine-tune language and vision models using TRL (Transformer Reinforcement Learning) or…Data & Analyticshf-cloud-python-env-setupSet up an isolated Python environment for SageMaker / AWS work, with the right Python version and…DevOps & Cloudhf-cloud-sagemaker-iam-preflightEnsure a usable SageMaker execution role exists before deploying or training. Use this skill…Backend & APIhf-cloud-serving-image-selectionPick the right serving container for a SageMaker model deployment and find its current image URI.…DevOps & Cloudhuggingface-paper-publisherPublish and manage research papers on Hugging Face Hub. Supports creating paper pages, linking…Other
About this skill
What does the huggingface-community-evals skill do?

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

How do I install it?

Run `npx skills add waybarrios/opencode-power-pack --skill huggingface-community-evals --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.

Where does this skill come from?

From waybarrios/opencode-power-pack, a repository with 443 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.

Is a popular skill a good skill?

Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.

Keep going
All skills →
The full catalog, by category and by tool.
Open Source Radar →
The repositories these skills come from, watched daily.
The people behind them →
Makers and builders across the ecosystem.