gahow/aituner
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Report failed fidelity pilot gate

Browse Source
This commit is contained in:
Gahow Wang
2026-07-14 13:57:12 +08:00
parent 24a9c27b10
commit f01819680d
3 changed files with 259 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
docs/fidelity-aware-harness-protocol-20260714.md
View File

@@ -1,9 +1,18 @@
# Fidelity-aware real-verification harness protocol
Status: **PRE-REGISTERED STAGED EVALUATION; CONTRIBUTION NOT YET ESTABLISHED**.
Status: **P1 FAILED; P2/P3 CLOSED FOR THE REGISTERED METHOD; CONTRIBUTION NOT ESTABLISHED**.
Date frozen: 2026-07-14 (Asia/Singapore).
Post-run disposition (2026-07-14): P1 completed with valid data but failed its
registered incremental gate. The strengthened simulator-aware comparison and
end-to-end `k=2` replay also failed: instrumentation was safe and retained zero
regret, but reduced online H20-hours by only 1.426% versus sim top-k + real
final, against the 30% bar. Outcome-only was unsafe. P2/P3 are therefore not
opened for this model. Full results and the permitted reopening condition are
in `docs/fidelity-aware-harness-p1-report-20260714.md`; the protocol below is
retained unchanged as the pre-run record.
## Research question and contribution bar
The harness has an independent systems contribution only if engine-internal