dask
Distributed computing for larger-than-RAM pandas/NumPy workflows. Use when you need to scale existing pandas/NumPy code beyond memory or across clusters. Best for parallel file processing, distributed ML, integration with existing pandas code. For out-of-core analytics on single machine use vaex; for in-memory speed use polars.
npx skills add LeonChaoX/qinyan-academic-skills --skill dask --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Dask ## Overview Dask is a Python library for parallel and distributed computing that enables three critical capabilities: - **Larger-than-memory execution** on single machines for data exceeding available RAM - **Parallel processing** for improved computational speed across multiple cores - **Distributed computation** supporting terabyte-scale datasets across multiple machines Dask scales from laptops (processing ~100 GiB) to clusters (processing ~100 TiB) while maintaining familiar Python APIs. ## When to Use This Skill This skill should be used when: - Process datasets that exceed available RAM - Scale pandas or NumPy operations to larger datasets - Parallelize computations for performance improvements - Process multiple files efficiently (CSVs, Parquet, JSON, text logs) - Build custom parallel workflows with task dependencies - Distribute workloads across multiple cores or machines ## Core Capabilities Dask provides five main components, each suited to different use cases: ### 1. DataFrames - Parallel Pandas Operations **Purpose**: Scale pandas operations to larger datasets through parallel processing. **When to Use**: - Tabular data exceeds available RAM - Need to process mu
- Overview
- When to Use This Skill
- Core Capabilities
- 1. DataFrames - Parallel Pandas Operations
- 2. Arrays - Parallel NumPy Operations
- 3. Bags - Parallel Processing of Unstructured Data
- 4. Futures - Task-Based Parallelization
- 5. Schedulers - Execution Backends
- Best Practices
- Start with Simpler Solutions
- Critical Performance Rules
- Common Workflow Patterns
- ETL Pipeline
- Unstructured to Structured Pipeline
What does the dask skill do?
Distributed computing for larger-than-RAM pandas/NumPy workflows. Use when you need to scale existing pandas/NumPy code beyond memory or across clusters. Best for parallel file processing, distributed ML, integration with existing pandas code. For out-of-core analytics on single machine use vaex; for in-memory speed use polars.
How do I install it?
Run `npx skills add LeonChaoX/qinyan-academic-skills --skill dask --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From LeonChaoX/qinyan-academic-skills, a repository with 759 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.