fabric-dataflows-perf-remediationlisted

Diagnose and resolve Microsoft Fabric Dataflow Gen2 performance issues including slow refresh times, Fast Copy optimization, query folding failures, staging bottlenecks, gateway latency, incremental refresh tuning, capacity throttling, and data destination write performance. Use when troubleshooting dataflow refresh failures, optimizing Dataflow Gen2 execution time, debugging Power Query mashup engine performance, resolving staging Lakehouse or Warehouse compute issues, configuring Fast Copy connectors, fixing insufficient permissions errors, monitoring dataflow refresh history, or automating dataflow health checks via REST API and PowerShell.
PatrickGallucci/fabric-skills · ★ 13 · Data & Documents · score 81

Install: claude install-skill PatrickGallucci/fabric-skills

# Dataflows Gen2 Performance Troubleshooting Systematic diagnostic workflows for identifying and resolving performance issues in Microsoft Fabric Dataflow Gen2 workloads covering data movement, transformation execution, staging configuration, and destination write optimization. ## When to Use This Skill - Dataflow Gen2 refresh takes longer than expected - Fast Copy is not being utilized or is failing - Query folding indicators show red or yellow steps - Staging-to-destination data movement is a bottleneck - Gateway-connected dataflows have high latency - Incremental refresh is slower than full refresh - Capacity throttling affects dataflow execution - Refresh failures with permission or connector errors - Need to automate dataflow monitoring and health checks - Migrating from Dataflow Gen1 and seeing performance regressions ## Prerequisites - Microsoft Fabric workspace with Data Factory enabled - Contributor or higher role on the workspace - PowerShell 7+ with Az.Accounts module for automation scripts - Access to Fabric Monitoring Hub for refresh history analysis - Fabric Capacity Metrics app access for CU consumption review --- ## Quick Diagnosis: Symptom-to-Solution Map | Symptom | Likely Cause | Jump To | |---------|-------------|---------| | Refresh takes 2x+ longer than Gen1 | Delta Parquet output overhead or staging misconfiguration | [Consideration 5 in Performance Guide](./references/performance-optimization-guide.md#gen1-vs-gen2-runtime) | | Fast Copy not act