protocol_video_matching
Real-time XR video vs. protocol text matching and deviation detection. Aligns first-person XR headset video streams frame-by-frame against structured protocol steps, flags procedural deviations, scores compliance, and delivers corrective audio/visual overlays — enabling one-person lab operation with zero-missed-step guarantees.
npx skills add BioTender-max/awesome-bio-agent-skills --skill protocol_video_matching --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Protocol Video Matching ## Overview `protocol_video_matching` bridges the physical bench and the digital protocol by continuously aligning a first-person XR headset video stream (e.g., Meta Quest, HoloLens 2, Magic Leap) against structured protocol text in real time. The skill parses each protocol step into a semantic action graph, tracks operator gestures and reagent interactions through a Vision-Language Model (VLM), detects when execution diverges from the ground-truth procedure, and surfaces instant corrective guidance as spatial overlays — turning every researcher into a compliant, self-auditing one-person lab. ## When to Use This Skill Use this skill when any of the following conditions are present: - **Live XR-assisted experiments**: An operator wearing a first-person XR headset is executing a wet-lab protocol (PCR, cell culture, CRISPR editing, RNA extraction, Western blot, etc.) and needs real-time step-by-step guidance or compliance validation. - **Protocol compliance auditing**: A lab manager needs post-hoc or live documentation showing whether a protocol was followed exactly — including timing, reagent volumes, temperature set-points, and action sequence. - **Deviatio
- Overview
- When to Use This Skill
- Core Capabilities
- 1. Protocol Parsing & Action Graph Construction
- 2. Real-Time Video Frame Analysis via VLM
- 3. Deviation Detection & Compliance Scoring
- 4. Real-Time XR Corrective Guidance Overlay
- 5. Audit Trail & Report Generation
- 6. Offline & Edge Inference Mode
- Usage Examples
- Example 1 — Live RNA Extraction Compliance Check
- Example 2 — Post-Hoc Protocol Compliance Report from Recorded Video
- Example 3 — Opentrons Robot Protocol Validation via Overhead Camera
- Integration Notes
What does the protocol_video_matching skill do?
Real-time XR video vs. protocol text matching and deviation detection. Aligns first-person XR headset video streams frame-by-frame against structured protocol steps, flags procedural deviations, scores compliance, and delivers corrective audio/visual overlays — enabling one-person lab operation with zero-missed-step guarantees.
How do I install it?
Run `npx skills add BioTender-max/awesome-bio-agent-skills --skill protocol_video_matching --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From BioTender-max/awesome-bio-agent-skills, a repository with 135 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.