Follow-ups deferred from the PR for #6 (clean-replay grading). None block the v1.0 rigor bar; #6 already makes clean-replay THE grading path and the gate fail-closed on missing/mismatched provenance. These harden it further.
Deferred hardening (from the #6 review panel: Opus + GLM + codex-sol)
Pre-existing flaky test (unrelated to #6, found while validating)
Follow-ups deferred from the PR for #6 (clean-replay grading). None block the v1.0 rigor bar; #6 already makes clean-replay THE grading path and the gate fail-closed on missing/mismatched provenance. These harden it further.
Deferred hardening (from the #6 review panel: Opus + GLM + codex-sol)
gradingMode: 'clean_replay'string. Now mitigated by enforcingagentWorkspaceIsolation.restrictedPathsAbsent, but there is no fully independent post-hoc proof a separate grading dir was used. Consider recording + asserting the grading path differs from the agent-workspace path._hiddenFixtureIsolationprobes the agent workspace after the run; an agent could in principle read + delete a leaked fixture before the probe. Primary defense (_shouldExcludeWorkspacePathnever assembles_hiddeninto the agent workspace) is solid, so this is defense-in-depth. Fix: snapshot the workspace file manifest before the agent runs and diff post-run.taskBundleDigest. Evaluator-visible (non-hidden) fixture drift goes undetected. Lower risk than hidden-verifier drift.release_report.dart_stringMapEqualsvsleaderboard_exporter.dart_mapEqualsare near-identical.Pre-existing flaky test (unrelated to #6, found while validating)
test/agent/agent_harness_test.dart—MinimalAgentHarness bounds command outputexpectsAgentRunStatus.failureon output flood but races tosuccess. Fails deterministically in isolation onmain(3/3), passes in the full parallel suite. Make the flood deterministic (sustained output that always trips the bound before completion).