dagster-expert

Solid

Expert guidance for working with Dagster and the dg CLI. ALWAYS use before doing any task that requires knowledge specific to Dagster, or that references assets, materialization, components, data tools or data pipelines. Common tasks may include creating a new project, adding new definitions, understanding the current project structure, answering general questions about the codebase (finding asset, schedule, sensor, component or job definitions), debugging issues, or providing deep information about a specific Dagster concept.

Data & Documents 203 stars 16 forks Updated today Apache-2.0

Install

View on GitHub

Quality Score: 86/100

Stars 20%
77
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

## Core Dagster Concepts Brief definitions only (see reference files for detailed examples): - **Asset**: Persistent object (table, file, model) produced by your pipeline - **Component**: Reusable building block that generates definitions (assets, schedules, sensors, jobs, etc.) relevant to a particular domain. ## Integration Workflow When integrating with ANY external tool or service, read the [Integration libraries index](./references/integrations/INDEX.md). This contains information about which integration libraries exist, and references on how to create new custom integrations for tools that do not have a published library. ## Programmatic Access: `dg` CLI and the Dagster Plus MCP server There are two ways to interact with Dagster programmatically. Pick by where the work happens: - **The `dg` CLI** — everything in the local project: adding definitions, scaffolding, validating, exploring project structure, and launching runs locally. Installed as part of the `dagster-dg-cli` package. If a relevant CLI command for a local task exists, always attempt to use it. - **The Dagster Plus MCP server** — querying and managing a deployed Dagster Plus organization: runs, assets, deployments, code locations, alert policies, Issues, and insights metrics. When it is connected, prefer its tools over the equivalent `dg api` commands. `dg api` covers the same deployed resources as the MCP server from the command line, and remains the way to reach the parts the server does not expose...

Details

Author
dagster-io
Repository
dagster-io/skills
Created
7 months ago
Last Updated
today
Language
Python
License
Apache-2.0

Integrates with

Bundled in these plugins

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Listed

building-dagster-assets

Build Dagster pipelines using software-defined assets — asset dependencies, partitions, resources and IO managers, asset checks, and schedules/sensors. Use when creating Dagster assets or jobs, modeling data as assets, adding partitions or backfills, wiring resources/IO managers, or migrating from task-based orchestration to assets.

17 Updated 1 weeks ago
Unknown-333
AI & Automation Listed

dagster-orchestration-adapter

Run the medallion sequence UNATTENDED / in CI as a Dagster asset graph -- the scheduler sibling of the retail-orchestrate conductor -- running ONLY already-approved steps behind every gate, and recording what each asset DID as DERIVED run-evidence. Use when someone asks to schedule the pipeline, run the medallion in CI, "orchestrate unattended", or wire Dagster in the Seshat BI repo. Dagster RUNS approved steps; Tower BI (the gate exit code + the named human) decides whether a stage passed. This skill READS committed approvals as the GO signal, EXECUTES approved steps behind STOP / HUMAN-SEAM edges, and WRITES run-evidence; it never defines meaning, never moves a stage to pass, never publishes Power BI (it only TRIGGERS F016), and HARD-STOPS at every human judgment call.

2 Updated 2 days ago
Kemetra
AI & Automation Listed

airflow-dags

Use when creating, debugging, or configuring Apache Airflow 3 DAGs — builds data pipelines with TaskFlow API or traditional operators, configures scheduling and asset-driven triggers, wires XCom data passing, sets up sensors and deferrable operators, generates dynamic task mappings, and structures multi-layer test suites. Triggers on DAG authoring, TaskFlow API, operators, sensors, scheduling, assets, dynamic tasks, XCom, or pipeline testing.

0 Updated 2 days ago
wagneripjr