The whole-mix-vs-stem decision (#92) was about to be called on a rigged comparison. `fit` grades whole-mix on every mix-analyzed track (163 so far, heading to 534) and `fit --stem` on every stem-analyzed track (24) — different SETS and different SIZES. The unpaired numbers (calibrated LOO 0.418 whole-mix vs 0.618 stem) screamed "whole-mix decisively wins," but most of that gap was sample size: 163 points fit a stable affine (in-sample→LOO gap 0.005), 24 points overfit it (gap 0.063). That's a sample-size artifact masquerading as a mode-quality verdict — exactly the kind of premature conclusion the build-the- katana-first discipline exists to catch. Approach: extract the raw/in-sample/LOO scoring into a shared `_evaluate()` so every mode is graded by identical code, then add `paired` — whole-mix vs stem head-to-head restricted to the slugs analyzed BOTH ways (the only honest comparison). Reports both modes' raw + calibrated-LOO V/A-err, quad-hit, emo-hit, plus an in-sample→LOO conditioning gap with an overfit flag. The surprise (n=26 paired, validated this run): on equal footing the verdict nearly inverts. whole-mix cal·LOO 0.569 / quad 54% / emo 23% vs stem 0.605 / 58% / 27% — whole-mix wins distance by Δ0.037, but stem wins BOTH quadrant and emotion-hit, and both overfit (n=26 too small). The honest #92 answer is now "inconclusive until more stems exist," not "whole-mix decisively wins." Caveat: the paired subset is the hard cases (first-fetched = aggressive techno/dnb/ dubstep, the high-arousal region drift + the ontology critique both flagged). Regression: `fit` output unchanged after the refactor. Interim calibration JSON (n=163 fit) left uncommitted — it regenerates at the full 534.
| Name |
Last commit
|
Last update |
|---|---|---|
| armada | Loading commit data... | |
| blocks | Loading commit data... | |
| blog | Loading commit data... | |
| copycat | Loading commit data... | |
| gifts | Loading commit data... | |
| lib-parvagues | Loading commit data... | |
| live | Loading commit data... | |
| output | Loading commit data... | |
| releases | Loading commit data... | |
| sandbox | Loading commit data... | |
| study | Loading commit data... | |
| test | Loading commit data... | |
| tools | Loading commit data... | |
| utils | Loading commit data... | |
| viz | Loading commit data... | |
| .gitignore | Loading commit data... | |
| BootTidal.hs | Loading commit data... | |
| BootTidal.hs.broken | Loading commit data... | |
| BootTidal.visuals.broken.hs | Loading commit data... | |
| CLAUDE.md | Loading commit data... | |
| LICENSE | Loading commit data... | |
| PatchBay_MultiChannel.xml | Loading commit data... | |
| PatchBay_Perf.xml | Loading commit data... | |
| PatchBay_Perf5.1.xml | Loading commit data... | |
| README.md | Loading commit data... | |
| backlog.md | Loading commit data... | |
| bullet_train.tidal | Loading commit data... | |
| collide.sh | Loading commit data... | |
| debug.tidal | Loading commit data... | |
| didacticpatternvisualizer.pde | Loading commit data... | |
| hello.sc | Loading commit data... | |
| init_midi.sh | Loading commit data... | |
| intro.md | Loading commit data... | |
| library.txt | Loading commit data... | |
| link_jack.sh | Loading commit data... | |
| link_samples.sh | Loading commit data... | |
| link_samples_all.txt | Loading commit data... | |
| main_fairbanks.scd | Loading commit data... | |
| notes.md | Loading commit data... | |
| perf-tray.py | Loading commit data... | |
| perf.sh | Loading commit data... | |
| samples.txt | Loading commit data... | |
| start_and_midi.scd | Loading commit data... | |
| test.tidal | Loading commit data... |