matlab-connect-databricks-spark
Set up the MATLAB Interface for Databricks and read data via Databricks Connect (Spark). Use when connecting MATLAB to Databricks for the first time, configuring authentication (OauthU2M, OauthM2M, PAT), creating Spark sessions with getDatabricksSession(), reading Unity Catalog tables, filtering DataFrames server-side, or converting results to MATLAB tables. Triggers on: Databricks Connect, Spark from MATLAB, getDatabricksSession, .databrickscfg, large table server-side filtering.
npx skills add matlab/matlab-agentic-toolkit --skill matlab-connect-databricks-spark --agent claude-code
Same command for any agent — swap --agent for codex, cursor, copilot.
Weekly change comes from our own snapshots, not the repository page — it measures attention, not adoption.
# MATLAB Interface for Databricks — Spark (Databricks Connect) Read data from Databricks into MATLAB via Databricks Connect. This skill covers first-time setup, authentication, and using Spark DataFrames from desktop MATLAB. ## When to Use - First-time setup of the MATLAB Interface for Databricks package - Configuring `.databrickscfg` and authentication (OauthU2M, OauthM2M, PAT) - Reading large tables via Spark with server-side filtering before pulling data locally - Creating a Spark session from desktop MATLAB (`getDatabricksSession`) - Converting Spark DataFrames to MATLAB tables or writing MATLAB tables back to Spark ## When NOT to Use - SQL queries on small-to-medium datasets via JDBC/ODBC — use `/matlab-connect-databricks-jdbc` - Deploying compiled MATLAB code to Databricks clusters (Job workflow) - Databricks Files API operations - REST API management (Clusters, Jobs, Unity Catalog admin) ## Workflow 0. **Obtain the package** — Ask the user if they already have the MATLAB Interface for Databricks downloaded locally. If not, direct them to download it from https://www.mathworks.com/solutions/partners/databricks.html 1. **Setup** — Run `setup` from the package directory to conf
- When to Use
- When NOT to Use
- Workflow
- Key Functions
- Patterns
- First-Time Setup
- Authentication Configuration
- Create a Spark Session (Classic Compute)
- Create a Spark Session (Serverless Compute)
- Read and Filter a Table
- Filter and Limit Rows
- Add Computed Columns with withColumn
- Read Files from Unity Catalog Volumes
- Convert MATLAB Table Back to Spark DataFrame
What does the matlab-connect-databricks-spark skill do?
Set up the MATLAB Interface for Databricks and read data via Databricks Connect (Spark). Use when connecting MATLAB to Databricks for the first time, configuring authentication (OauthU2M, OauthM2M, PAT), creating Spark sessions with getDatabricksSession(), reading Unity Catalog tables, filtering DataFrames server-side, or converting results to MATLAB tables. Triggers on: Databricks Connect, Spark from MATLAB, getDatabricksSession, .databrickscfg, large table server-side filtering.
How do I install it?
Run `npx skills add matlab/matlab-agentic-toolkit --skill matlab-connect-databricks-spark --agent claude-code` — it drops the skill into your project so the agent can pick it up. Swap the --agent value for codex, cursor or copilot if you use one of those.
Where does this skill come from?
From matlab/matlab-agentic-toolkit, a repository with 868 stars. We read it straight from the repository tree rather than a submitted listing, so what you see here is what is actually published.
Is a popular skill a good skill?
Not necessarily. Stars measure attention, not adoption — a repository can trend for a week and be abandoned. That is why we show the weekly change from our own snapshots next to the total, instead of a single flattering number.