Apache Spark Optimizer
Analyzes and optimizes Apache Spark jobs for performance, cost, and resource utilization
npx skills add a5c-ai/babysitter --skill apache-spark-optimizer --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# Apache Spark Optimizer ## Overview Analyzes and optimizes Apache Spark jobs for performance, cost, and resource utilization. This skill provides deep expertise in Spark execution plans, partitioning strategies, and resource configuration to maximize efficiency. ## Capabilities - Spark execution plan analysis and optimization - Partition strategy recommendations - Shuffle reduction techniques - Memory and executor configuration tuning - Catalyst optimizer hints generation - Data skew detection and mitigation - Broadcast join optimization - Caching strategy recommendations ## Input Schema ```json { "sparkCode": "string", "clusterConfig": "object", "executionMetrics": "object", "dataCharacteristics": { "volumeGB": "number", "partitionCount": "number", "skewFactor": "number" } } ``` ## Output Schema ```json { "optimizedCode": "string", "recommendations": ["string"], "expectedImprovement": { "executionTime": "percentage", "resourceUsage": "percentage", "cost": "percentage" }, "configChanges": "object" } ``` ## Target Processes - ETL/ELT Pipeline - Streaming Pipeline - Feature Store Setup - Pipeline Migration ## Usage Guidelines 1. Provide the Spark code or job definition for analysis
- Overview
- Capabilities
- Input Schema
- Output Schema
- Target Processes
- Usage Guidelines
- Best Practices
What does the Apache Spark Optimizer skill do?
Analyzes and optimizes Apache Spark jobs for performance, cost, and resource utilization
How do I install it?
Run `npx skills add a5c-ai/babysitter --skill apache-spark-optimizer --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From a5c-ai/babysitter, a repository with 1,642 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.