a-combination-is-not-the-candidate-set
SolidUse once more than one trained artifact exists on disk -- two checkpoints, two seeds, two architectures, a continuation run -- and something is deciding which of them, or which combination of them, writes the predictions file. Covers the ballot that lists every artifact as a submission on its own before any blend, re-running it whenever a training job finishes, the known-bad canary that tests the objective, and persisting a rejected candidate's predictions.
Install
Quality Score: 82/100
Skill Content
Details
- Author
- tangxiangru
- Repository
- tangxiangru/AutoR
- Created
- 6 months ago
- Last Updated
- 2 weeks ago
- Language
- Python
- License
- NOASSERTION
Integrates with
Similar Skills
Semantically similar based on skill content — not just same category
combine-is-the-third-outcome-of-an-adoption-test
Use at hypothesis generation and study design when you are about to write a decision rule of the form "adopt the new method only if it beats the current one on held-out data", and at implementation and experimentation when a second scorer, prompt, view, feature set or model has just come in below the one you are already shipping. Covers registering combine as a third outcome beside replace and discard, the two counts that say whether a losing method still holds information, blending scores instead of decisions, and the pre-registration and nested cross-validation that stop a blend search from inventing its own lift.
artifact-arena
Use when asked to run /artifact-arena to generate and judge competing artifact implementations. Not for remote, credential, publish, deploy, or irreversible changes.
a-scoreable-file-in-the-first-hour
Use at the first stage of a run whose deliverable is a predictions file, and again at every stage when one still does not exist. Covers why a trivial submission written early dominates a good one written late, what the first version should contain, and how to improve it in place without ever leaving it invalid.