swmm-experiment-audit

Solid

Consolidate Agentic SWMM run artifacts into auditable provenance, comparison records, and local Obsidian audit notes. Use after any SWMM build/run/QA attempt, successful or failed, when an agent or CLI workflow needs a traceable record of inputs, commands, artifacts, metrics, QA checks, run-to-run differences, and first-user-friendly Obsidian visualization.

AI & Automation 21 stars 9 forks Updated 3 days ago MIT

Install

View on GitHub

Quality Score: 78/100

Stars 20%
45
Recency 20%
100
Frontmatter 20%
70
Documentation 15%
100
Issue Health 10%
50
License 10%
100
Description 5%
100

Skill Content

# SWMM Experiment Audit Part of [Agentic SWMM](https://github.com/Zhonghao1995/agentic-swmm-workflow) — install the project first for the executable toolchain (aiswmm CLI, SWMM solver, MCP servers). ## What this skill provides - A standard audit layer for Agentic SWMM runs. - Consolidation of dispersed `manifest.json`, QA JSON, logs, metrics, and artifact paths. - Machine-readable outputs for reproducibility and review. - Obsidian-compatible Markdown notes for human research records. - Default local Obsidian export into a clean English audit vault. - Automatic update of the Obsidian `Experiment Audit Index`. - Optional run-to-run comparison for baseline/scenario or before/after parser validation. This skill records what happened. It does not run SWMM, build models, invent missing artifacts, or replace module-level validation. ## When to use this skill Use this skill after any of these events: - `swmm-end-to-end` completes successfully. - `swmm-end-to-end` stops or fails after producing partial artifacts. - A user wants an Obsidian-ready experiment note for an existing run directory. - A user wants to compare two run directories. - A run needs evidence for reproducibility, metric provenance, QA status, or paper claims. Do not use this skill as a substitute for `swmm-runner`, `swmm-builder`, or calibration tools. Run the model first, then audit the run directory. ## Output contract For every audited run, write these files into the run's `09_audit/` directory unless ex...

Details

Author
Zhonghao1995
Repository
Zhonghao1995/agentic-swmm-workflow
Created
5 months ago
Last Updated
3 days ago
Language
Python
License
MIT

Integrates with

Similar Skills

Semantically similar based on skill content — not just same category

AI & Automation Solid

swmm-modeling-memory

Read historical Agentic SWMM experiment audit artifacts and summarize repeated assumptions, QA issues, failures, missing evidence, run-to-run differences, lessons learned, and controlled skill update proposals. Use downstream of swmm-experiment-audit when multiple audited runs exist or when a user asks for modeling memory, failure-pattern extraction, lessons learned, or human-reviewed skill refinement proposals.

21 Updated 3 days ago
Zhonghao1995
Data & Documents Solid

swmm-report

Generate a client-deliverable Word (.docx) report from an audited SWMM run directory. Reads manifest.json, experiment_provenance.json, model_diagnostics.json, comparison.json, and any PNG figures — SWMM is never re-run. Supports custom YAML/JSON section templates.

21 Updated 3 days ago
Zhonghao1995
AI & Automation Listed

experiment-audit

Use this skill for scientific and ML-research reasoning work — evaluating experimental claims, auditing training runs or ablations, checking whether a statistical claim holds up, assessing reproducibility, reconciling contradictory results, reviewing a paper's methodology or results section, writing reviewer-style feedback, or producing a structured research report. This is a scientific reasoning discipline, not just a tool wrapper, so it applies even with no live data source — e.g. reviewing a pasted table of results, sanity-checking a claimed effect size, or evaluating an ablation described in prose. Trigger on phrasing like "did I mess up this experiment," "is this result real," "why did my loss/reward do X," "which run is better," "is this ablation confounded," "review this paper's claims," "write reviewer feedback," "is this reproducible," "what should I conclude from this," or "write up these results." When the user's data lives in Weights & Biases, this skill also covers the experiment-audit-mcp integr

4 Updated 1 weeks ago
SreeDharshan-GJ