The whole-mix-vs-stem decision (#92) was about to be called on a rigged comparison. `fit` grades whole-mix on every mix-analyzed track (163 so far, heading to 534) and `fit --stem` on every stem-analyzed track (24) — different SETS and different SIZES. The unpaired numbers (calibrated LOO 0.418 whole-mix vs 0.618 stem) screamed "whole-mix decisively wins," but most of that gap was sample size: 163 points fit a stable affine (in-sample→LOO gap 0.005), 24 points overfit it (gap 0.063). That's a sample-size artifact masquerading as a mode-quality verdict — exactly the kind of premature conclusion the build-the- katana-first discipline exists to catch. Approach: extract the raw/in-sample/LOO scoring into a shared `_evaluate()` so every mode is graded by identical code, then add `paired` — whole-mix vs stem head-to-head restricted to the slugs analyzed BOTH ways (the only honest comparison). Reports both modes' raw + calibrated-LOO V/A-err, quad-hit, emo-hit, plus an in-sample→LOO conditioning gap with an overfit flag. The surprise (n=26 paired, validated this run): on equal footing the verdict nearly inverts. whole-mix cal·LOO 0.569 / quad 54% / emo 23% vs stem 0.605 / 58% / 27% — whole-mix wins distance by Δ0.037, but stem wins BOTH quadrant and emotion-hit, and both overfit (n=26 too small). The honest #92 answer is now "inconclusive until more stems exist," not "whole-mix decisively wins." Caveat: the paired subset is the hard cases (first-fetched = aggressive techno/dnb/ dubstep, the high-arousal region drift + the ontology critique both flagged). Regression: `fit` output unchanged after the refactor. Interim calibration JSON (n=163 fit) left uncommitted — it regenerates at the full 534.
| Name |
Last commit
|
Last update |
|---|---|---|
| .. | ||
| _corpus_cache | Loading commit data... | |
| punkachien | Loading commit data... | |
| sources | Loading commit data... | |
| tests | Loading commit data... | |
| .gitignore | Loading commit data... | |
| README.md | Loading commit data... | |
| ardour_stem_export.py | Loading commit data... | |
| audio_lens.py | Loading commit data... | |
| backlog_setlists.json | Loading commit data... | |
| backlog_setlists.py | Loading commit data... | |
| boundaries_take89_validated.json | Loading commit data... | |
| boundary_bleed.py | Loading commit data... | |
| boundary_bleed_take89.json | Loading commit data... | |
| build_catalog.py | Loading commit data... | |
| build_catalog_view.py | Loading commit data... | |
| build_corpus.py | Loading commit data... | |
| build_eda.py | Loading commit data... | |
| build_landing.py | Loading commit data... | |
| build_presence.py | Loading commit data... | |
| build_provenance.py | Loading commit data... | |
| build_tierlist.py | Loading commit data... | |
| build_track_recording_map.py | Loading commit data... | |
| build_triage_ui.py | Loading commit data... | |
| build_unwrapped.py | Loading commit data... | |
| calibration.json | Loading commit data... | |
| calibration.whole-mix.json | Loading commit data... | |
| catalog.authored.yaml | Loading commit data... | |
| catalog.generated.json | Loading commit data... | |
| catalog.yaml | Loading commit data... | |
| catalog_view.json | Loading commit data... | |
| corpus-viz-plan.md | Loading commit data... | |
| corpus.html | Loading commit data... | |
| eda-grounding-plan.md | Loading commit data... | |
| eda_Take14.json | Loading commit data... | |
| eda_Take15.json | Loading commit data... | |
| eda_Take16.json | Loading commit data... | |
| eda_Take17.json | Loading commit data... | |
| eda_Take18.json | Loading commit data... | |
| eda_Take19.json | Loading commit data... | |
| eda_Take20.json | Loading commit data... | |
| eda_Take21.json | Loading commit data... | |
| eda_Take22.json | Loading commit data... | |
| eda_Take24.json | Loading commit data... | |
| eda_Take28.json | Loading commit data... | |
| eda_Take29.json | Loading commit data... | |
| eda_Take3.json | Loading commit data... | |
| eda_Take30.json | Loading commit data... | |
| eda_Take32.json | Loading commit data... | |
| eda_Take33.json | Loading commit data... | |
| eda_Take34.json | Loading commit data... | |
| eda_Take35.json | Loading commit data... | |
| eda_Take36.json | Loading commit data... | |
| eda_Take37.json | Loading commit data... | |
| eda_Take38.json | Loading commit data... | |
| eda_Take39.json | Loading commit data... | |
| eda_Take4.json | Loading commit data... | |
| eda_Take40.json | Loading commit data... | |
| eda_Take42.json | Loading commit data... | |
| eda_Take45.json | Loading commit data... | |
| eda_Take49.json | Loading commit data... | |
| eda_Take5.json | Loading commit data... | |
| eda_Take53.json | Loading commit data... | |
| eda_Take54.json | Loading commit data... | |
| eda_Take55.json | Loading commit data... | |
| eda_Take58.json | Loading commit data... | |
| eda_Take59.json | Loading commit data... | |
| eda_Take61.json | Loading commit data... | |
| eda_Take62.json | Loading commit data... | |
| eda_Take63.json | Loading commit data... | |
| eda_Take64.json | Loading commit data... | |
| eda_Take65.json | Loading commit data... | |
| eda_Take66.json | Loading commit data... | |
| eda_Take67.json | Loading commit data... | |
| eda_Take68.json | Loading commit data... | |
| eda_Take70.json | Loading commit data... | |
| eda_Take71.json | Loading commit data... | |
| eda_Take72.json | Loading commit data... | |
| eda_Take73.json | Loading commit data... | |
| eda_Take74.json | Loading commit data... | |
| eda_Take75.json | Loading commit data... | |
| eda_Take76.json | Loading commit data... | |
| eda_Take77.json | Loading commit data... | |
| eda_Take79.json | Loading commit data... | |
| eda_Take8.json | Loading commit data... | |
| eda_Take80.json | Loading commit data... | |
| eda_Take82.json | Loading commit data... | |
| eda_Take83.json | Loading commit data... | |
| eda_Take84.json | Loading commit data... | |
| eda_Take85.json | Loading commit data... | |
| eda_Take86.json | Loading commit data... | |
| eda_Take87.json | Loading commit data... | |
| eda_Take88.json | Loading commit data... | |
| eda_Take89.json | Loading commit data... | |
| eda_Take90.json | Loading commit data... | |
| eda_report.json | Loading commit data... | |
| eda_status.json | Loading commit data... | |
| edl_render.py | Loading commit data... | |
| emotion_calibrate.py | Loading commit data... | |
| emotion_corpus.py | Loading commit data... | |
| emotion_corpus_gt.json | Loading commit data... | |
| emotion_corpus_merge.py | Loading commit data... | |
| emotion_drift.json | Loading commit data... | |
| emotion_drift.py | Loading commit data... | |
| emotion_ontology.py | Loading commit data... | |
| emotion_ontology_critique.json | Loading commit data... | |
| emotion_overnight.py | Loading commit data... | |
| emotion_timeline.py | Loading commit data... | |
| feature_eda.json | Loading commit data... | |
| feature_eda.py | Loading commit data... | |
| foundry_stems.py | Loading commit data... | |
| gap-report.md | Loading commit data... | |
| index.html | Loading commit data... | |
| landing.json | Loading commit data... | |
| locate-matrix.md | Loading commit data... | |
| master_align.json | Loading commit data... | |
| master_edl_take89.json | Loading commit data... | |
| models.py | Loading commit data... | |
| pattern_ngrams.py | Loading commit data... | |
| pattern_registry.json | Loading commit data... | |
| performance_notes.md | Loading commit data... | |
| presence.authored.yaml | Loading commit data... | |
| presence.json | Loading commit data... | |
| provenance.json | Loading commit data... | |
| release_candidates.json | Loading commit data... | |
| release_priority.md | Loading commit data... | |
| resplit_montreuil.py | Loading commit data... | |
| sample_classify.py | Loading commit data... | |
| sample_families.json | Loading commit data... | |
| sample_features.json | Loading commit data... | |
| sample_features.py | Loading commit data... | |
| sample_meta.py | Loading commit data... | |
| sample_ontology.py | Loading commit data... | |
| sample_packs.json | Loading commit data... | |
| sample_packs.py | Loading commit data... | |
| sample_panns.py | Loading commit data... | |
| sample_resolve.py | Loading commit data... | |
| sample_semantics.py | Loading commit data... | |
| sample_tfidf.json | Loading commit data... | |
| seed_edl_take89.py | Loading commit data... | |
| semantics_embeds.npz | Loading commit data... | |
| take-compare.html | Loading commit data... | |
| take_gig_map.md | Loading commit data... | |
| tidal_score.py | Loading commit data... | |
| tide.py | Loading commit data... | |
| tide_eda.py | Loading commit data... | |
| tierlist.html | Loading commit data... | |
| tierlist.json | Loading commit data... | |
| tokens.json | Loading commit data... | |
| track_recording_map.json | Loading commit data... | |
| triage.csv | Loading commit data... | |
| triage.html | Loading commit data... | |
| triangle.html | Loading commit data... | |
| unwrapped.html | Loading commit data... | |
| unwrapped.json | Loading commit data... |