Model Validation Infrastructure, Script, and Workflow - #432

Open

cwitkowitz wants to merge 8 commits into

fc/model_validation2

Commits on Jul 15, 2026

Set up model validation infrastructure, script, and workflow from scratch using Claude's Fable.
cwitkowitz
committed
6dc7bd7

Commits on Jul 17, 2026

Refactored model validation into modules; added ZeroGPU-aware quota tracking, output inspection via expect rules and custom validators, and fixed the post-run hang.
cwitkowitz
committed
516d720

Commits on Jul 21, 2026

Commits on Jul 23, 2026

No longer attempting to track ZeroGPU quota explicitly, skip-zerogpu option, retrying loading ZeroGPU models, and updates to printouts and README.
cwitkowitz
committed
786bca2

Commits on Jul 24, 2026

Added MIDI output rules and reusable test cases, lowered timeout for ZeroGPU models, graceful handling of remaining ZeroGPU models after quota exceeded, and improved reporting.
cwitkowitz
committed
bdbaf1b

Commits on Jul 31, 2026

Added ability to set number of ZeroGPU workers, added ability to specify properties of synthesized inputs, only None for text_box value goes to default string, and some overall polishing.
cwitkowitz
committed
359ba55