RECONCILIATION.md

Budget-outcome reconciliation

Harbor multi-harness checkpoints 900 and 1,000 now include the original verifier scores for their remaining agent-budget failures. The old driver discarded these scores whenever an agent error was present. Recovery accepts only recorded deadline/output-budget terminations with matching native results, verifier files and exact-token captures; transport and capture failures remain excluded. No missing value was guessed or assigned a default zero. Every previously accepted grade is unchanged.

This accounting correction is limited to the missing cells at these checkpoints. Earlier accepted cells retain the historical retry policy. A uniform retrospective audit is required before interpreting the whole curve as strict first-attempt pass@1. Scores here retain the experiment's existing pass@1 metric name and provenance.

All three trainers finished 1,000 optimizer steps. Harbor OpenCode-only reached the step cap with 523 distinct training tasks represented in optimizer input; it did not cover the entire 1,000-task set.

• Checkpoint 900: 22.7%, 1,000/1,000 cells; 993 prior grades preserved, 7 original budget outcomes recovered. Full TiTO and pinned harness-version checks passed.

• Checkpoint 1000: 26.3%, 1,000/1,000 cells; 984 prior grades preserved, 16 original budget outcomes recovered. Full TiTO and pinned harness-version checks passed.