Decompose good/bad selection split across frozen surfaces

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This commit is contained in:
2026-07-20 12:05:20 +08:00
parent 18c0b25ae7
commit 39766141fb
54 changed files with 24465 additions and 5 deletions

Binary file not shown.

After

Width:  |  Height:  |  Size: 124 KiB

File diff suppressed because it is too large Load Diff

View File

@@ -0,0 +1,301 @@
# Frontier good/bad split decomposition
All 70 rows are recomputed from frozen per-config JSON values. Lower is better for every objective. `scale` is the geometric mean of `sim/real`; spreads are shown as `100 ×` log-space width, while `real margin` is the ordinary relative difference `100 × (real_second / real_best - 1)`. H-SCALE compares the log-space spread with `log1p(real margin)`, not directly with the ordinary relative margin. The real top-3 neighborhood is selected independently for every row. Directional `m_s` and `delta_s` are already expressed in log-percentage points.
- Rows / case surfaces: 70 / 14.
- Failures (`regret > 5%`): 23.
- Exact winner mismatches: 47.
- H-SCALE counterexamples: 40.
## Unified decomposition
| case | objective | sim winner | real winner | regret | scale | spread all | spread real top-3 | real margin (relative) | sim-winner real loss | failure | H-SCALE | deciding axis | m_s | delta_s | n_inv_tp | n_inv_mns | n_inv_mixed | fragile success |
|---|---|---|---|---:|---:|---:|---:|---:|---:|---|---|---|---:|---:|---:|---:|---:|---|
| q30 trace-pd | ttft_mean_ms | tp4_mns64 | tp4_mns64 | 0.0% | 45.900x | 414.0% | 73.5% | 52.8% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q30 trace-pd | ttft_p90_ms | tp4_mns64 | tp4_mns64 | 0.0% | 43.384x | 386.3% | 136.8% | 67.6% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q30 trace-pd | tpot_mean_ms | tp4_mns8 | tp4_mns8 | 0.0% | 4.799x | 34.2% | 11.9% | 30.3% | 0.0% | no | HOLDS | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q30 trace-pd | tpot_p90_ms | tp4_mns8 | tp4_mns8 | 0.0% | 4.291x | 34.9% | 10.9% | 32.9% | 0.0% | no | HOLDS | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q30 trace-pd | e2e_mean_ms | tp4_mns64 | tp4_mns64 | 0.0% | 8.263x | 109.9% | 50.1% | 6.6% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q30 trace-pd | e2e_p90_ms | tp4_mns64 | tp4_mns64 | 0.0% | 8.066x | 123.0% | 70.3% | 0.1% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | yes |
| q30 fixed-pd high | ttft_mean_ms | tp2_mns64 | tp4_mns32 | 58.0% | 80.274x | 664.7% | 229.2% | 0.0% | 58.0% | yes | HOLDS | mixed | 45.7% | -523.8% | 2 | 1 | 2 | no |
| q30 fixed-pd high | ttft_p90_ms | tp2_mns64 | tp4_mns64 | 56.2% | 130.663x | 709.3% | 222.7% | 0.1% | 56.2% | yes | HOLDS | tp-axis | 44.6% | -435.3% | 2 | 0 | 0 | no |
| q30 fixed-pd high | tpot_mean_ms | tp4_mns8 | tp4_mns8 | 0.0% | 6.313x | 118.1% | 95.7% | 34.4% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q30 fixed-pd high | tpot_p90_ms | tp4_mns8 | tp4_mns8 | 0.0% | 5.885x | 122.3% | 95.1% | 37.2% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q30 fixed-pd high | e2e_mean_ms | tp4_mns64 | tp1_mns32 | 1.7% | 18.867x | 226.5% | 111.5% | 0.7% | 1.7% | no | COUNTEREXAMPLE | mixed | 1.7% | -82.6% | 2 | 1 | 2 | no |
| q30 fixed-pd high | e2e_p90_ms | tp2_mns64 | tp1_mns32 | 5.5% | 24.706x | 274.2% | 172.5% | 1.0% | 5.5% | yes | HOLDS | mixed | 5.3% | -101.7% | 1 | 1 | 2 | no |
| q30 fixed-po high | ttft_mean_ms | tp4_mns16 | tp4_mns32 | 0.3% | 0.964x | 27.5% | 0.3% | 0.1% | 0.3% | no | COUNTEREXAMPLE | mns-axis | 0.3% | -0.3% | 0 | 0 | 0 | no |
| q30 fixed-po high | ttft_p90_ms | tp4_mns16 | tp4_mns32 | 0.5% | 0.956x | 26.9% | 0.3% | 0.0% | 0.5% | no | COUNTEREXAMPLE | mns-axis | 0.5% | -0.5% | 0 | 0 | 0 | no |
| q30 fixed-po high | e2e_mean_ms | tp4_mns16 | tp4_mns32 | 0.3% | 0.964x | 27.5% | 0.3% | 0.1% | 0.3% | no | COUNTEREXAMPLE | mns-axis | 0.3% | -0.3% | 0 | 0 | 0 | no |
| q30 fixed-po high | e2e_p90_ms | tp4_mns16 | tp4_mns32 | 0.5% | 0.956x | 26.9% | 0.3% | 0.0% | 0.5% | no | COUNTEREXAMPLE | mns-axis | 0.5% | -0.5% | 0 | 0 | 0 | no |
| q30 fixed-pd low | ttft_mean_ms | tp4_mns16 | tp4_mns16 | 0.0% | 1.368x | 43.8% | 1.5% | 1.3% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q30 fixed-pd low | ttft_p90_ms | tp4_mns16 | tp4_mns16 | 0.0% | 1.402x | 48.7% | 2.9% | 1.8% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q30 fixed-pd low | tpot_mean_ms | tp1_mns16 | tp4_mns32 | 14.0% | 4.952x | 52.7% | 0.2% | 0.0% | 14.0% | yes | HOLDS | mixed | 13.1% | -52.5% | 2 | 0 | 6 | no |
| q30 fixed-pd low | tpot_p90_ms | tp1_mns16 | tp4_mns8 | 13.4% | 4.950x | 53.2% | 0.3% | 0.2% | 13.4% | yes | HOLDS | mixed | 12.5% | -52.8% | 2 | 0 | 6 | no |
| q30 fixed-pd low | e2e_mean_ms | tp1_mns16 | tp4_mns32 | 26.9% | 4.423x | 59.8% | 0.2% | 0.1% | 26.9% | yes | HOLDS | mixed | 23.8% | -59.6% | 2 | 0 | 6 | no |
| q30 fixed-pd low | e2e_p90_ms | tp1_mns16 | tp4_mns8 | 25.7% | 4.421x | 60.0% | 0.2% | 0.1% | 25.7% | yes | HOLDS | mixed | 22.9% | -59.8% | 2 | 0 | 6 | no |
| q30 fixed-po low | ttft_mean_ms | tp4_mns16 | tp4_mns8 | 1.5% | 1.218x | 20.9% | 1.1% | 0.3% | 1.5% | no | COUNTEREXAMPLE | mns-axis | 1.5% | -1.5% | 0 | 0 | 0 | no |
| q30 fixed-po low | ttft_p90_ms | tp4_mns16 | tp4_mns8 | 3.6% | 1.184x | 16.1% | 2.3% | 0.6% | 3.6% | no | COUNTEREXAMPLE | mns-axis | 3.5% | -3.5% | 0 | 0 | 0 | no |
| q30 fixed-po low | e2e_mean_ms | tp4_mns16 | tp4_mns8 | 1.5% | 1.217x | 20.8% | 1.1% | 0.3% | 1.5% | no | COUNTEREXAMPLE | mns-axis | 1.5% | -1.5% | 0 | 0 | 0 | no |
| q30 fixed-po low | e2e_p90_ms | tp4_mns16 | tp4_mns8 | 3.6% | 1.183x | 16.0% | 2.4% | 0.7% | 3.6% | no | COUNTEREXAMPLE | mns-axis | 3.5% | -3.5% | 0 | 0 | 0 | no |
| q30 trace-po low | ttft_mean_ms | tp4_mns16 | tp4_mns64 | 3.2% | 0.657x | 18.2% | 2.6% | 1.7% | 3.2% | no | COUNTEREXAMPLE | mns-axis | 3.1% | -3.1% | 0 | 3 | 0 | no |
| q30 trace-po low | ttft_p90_ms | tp4_mns16 | tp4_mns8 | 0.4% | 0.478x | 17.7% | 0.2% | 0.2% | 0.4% | no | COUNTEREXAMPLE | mns-axis | 0.4% | -0.4% | 0 | 0 | 0 | no |
| q30 trace-po low | e2e_mean_ms | tp4_mns16 | tp4_mns64 | 3.2% | 0.657x | 18.2% | 2.6% | 1.7% | 3.2% | no | COUNTEREXAMPLE | mns-axis | 3.1% | -3.1% | 0 | 3 | 0 | no |
| q30 trace-po low | e2e_p90_ms | tp4_mns16 | tp4_mns8 | 0.3% | 0.478x | 17.7% | 0.2% | 0.1% | 0.3% | no | COUNTEREXAMPLE | mns-axis | 0.3% | -0.3% | 0 | 0 | 0 | no |
| q235 A0 fixed-pd | ttft_mean_ms | tp4_ep1_mns128 | tp8_ep8_mns128 | 4.2% | 0.991x | 6.1% | 5.0% | 0.4% | 4.2% | no | COUNTEREXAMPLE | tp-axis | 4.1% | -5.0% | 1 | 0 | 1 | no |
| q235 A0 fixed-pd | ttft_p90_ms | tp8_ep8_mns128 | tp8_ep8_mns64 | 0.2% | 1.020x | 2.4% | 2.4% | 0.2% | 0.2% | no | COUNTEREXAMPLE | mns-axis | 0.2% | -0.2% | 0 | 0 | 0 | no |
| q235 A0 fixed-pd | tpot_mean_ms | tp8_ep8_mns128 | tp4_ep1_mns128 | 33.0% | 3.025x | 64.0% | 63.9% | 0.7% | 33.0% | yes | HOLDS | tp-axis | 28.5% | -64.0% | 1 | 0 | 1 | no |
| q235 A0 fixed-pd | tpot_p90_ms | tp8_ep8_mns128 | tp4_ep1_mns128 | 37.2% | 3.062x | 62.9% | 62.8% | 0.3% | 37.2% | yes | HOLDS | tp-axis | 31.6% | -62.8% | 1 | 0 | 1 | no |
| q235 A0 fixed-pd | e2e_mean_ms | tp8_ep8_mns128 | tp4_ep1_mns128 | 30.7% | 2.913x | 61.5% | 61.5% | 0.7% | 30.7% | yes | HOLDS | tp-axis | 26.8% | -61.5% | 1 | 0 | 1 | no |
| q235 A0 fixed-pd | e2e_p90_ms | tp8_ep8_mns128 | tp4_ep1_mns128 | 34.6% | 2.955x | 60.5% | 60.4% | 0.3% | 34.6% | yes | HOLDS | tp-axis | 29.7% | -60.4% | 1 | 0 | 1 | no |
| q235 A0 fixed-po | ttft_mean_ms | tp4_ep1_mns128 | tp8_ep8_mns128 | 5.9% | 0.964x | 12.1% | 12.0% | 0.2% | 5.9% | yes | HOLDS | tp-axis | 5.7% | -12.0% | 1 | 0 | 1 | no |
| q235 A0 fixed-po | ttft_p90_ms | tp4_ep1_mns128 | tp8_ep8_mns128 | 1.7% | 0.941x | 8.3% | 8.0% | 0.3% | 1.7% | no | COUNTEREXAMPLE | tp-axis | 1.7% | -8.0% | 1 | 0 | 1 | no |
| q235 A0 fixed-po | e2e_mean_ms | tp4_ep1_mns128 | tp8_ep8_mns128 | 5.9% | 0.964x | 12.1% | 12.0% | 0.2% | 5.9% | yes | HOLDS | tp-axis | 5.7% | -12.0% | 1 | 0 | 1 | no |
| q235 A0 fixed-po | e2e_p90_ms | tp4_ep1_mns128 | tp8_ep8_mns128 | 1.7% | 0.941x | 8.3% | 8.0% | 0.3% | 1.7% | no | COUNTEREXAMPLE | tp-axis | 1.7% | -8.0% | 1 | 0 | 1 | no |
| q235 A0 trace-pd | ttft_mean_ms | tp8_ep8_mns128 | tp8_ep8_mns128 | 0.0% | 1.493x | 101.6% | 101.6% | 2220.3% | 0.0% | no | HOLDS | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q235 A0 trace-pd | ttft_p90_ms | tp8_ep8_mns128 | tp8_ep8_mns128 | 0.0% | 1.511x | 96.5% | 96.5% | 3455.8% | 0.0% | no | HOLDS | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q235 A0 trace-pd | tpot_mean_ms | tp8_ep8_mns64 | tp8_ep8_mns64 | 0.0% | 1.340x | 61.5% | 43.1% | 16.8% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q235 A0 trace-pd | tpot_p90_ms | tp8_ep8_mns64 | tp8_ep8_mns64 | 0.0% | 1.281x | 49.4% | 29.8% | 26.3% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q235 A0 trace-pd | e2e_mean_ms | tp8_ep8_mns128 | tp8_ep8_mns64 | 0.6% | 1.415x | 69.3% | 69.3% | 0.6% | 0.6% | no | COUNTEREXAMPLE | mns-axis | 0.6% | -18.1% | 0 | 1 | 0 | no |
| q235 A0 trace-pd | e2e_p90_ms | tp8_ep8_mns128 | tp8_ep8_mns64 | 6.2% | 1.473x | 71.5% | 71.5% | 6.2% | 6.2% | yes | HOLDS | mns-axis | 6.0% | -16.7% | 0 | 1 | 0 | no |
| q235 A0 trace-po | ttft_mean_ms | tp4_ep1_mns64 | tp8_ep8_mns128 | 7.0% | 0.753x | 36.3% | 34.6% | 1.4% | 7.0% | yes | HOLDS | mixed | 6.8% | -36.3% | 1 | 1 | 1 | no |
| q235 A0 trace-po | ttft_p90_ms | tp4_ep1_mns128 | tp8_ep8_mns64 | 21.2% | 0.767x | 31.8% | 31.6% | 0.3% | 21.2% | yes | HOLDS | mixed | 19.2% | -31.6% | 1 | 0 | 1 | no |
| q235 A0 trace-po | e2e_mean_ms | tp4_ep1_mns64 | tp8_ep8_mns128 | 7.0% | 0.753x | 36.3% | 34.6% | 1.4% | 7.0% | yes | HOLDS | mixed | 6.8% | -36.3% | 1 | 1 | 1 | no |
| q235 A0 trace-po | e2e_p90_ms | tp4_ep1_mns128 | tp8_ep8_mns64 | 21.2% | 0.766x | 31.8% | 31.6% | 0.3% | 21.2% | yes | HOLDS | mixed | 19.2% | -31.6% | 1 | 0 | 1 | no |
| q235 A1 fixed-pd | ttft_mean_ms | tp8_ep8_mns128 | tp8_ep8_mns128 | 0.0% | 0.805x | 26.8% | 26.8% | 0.4% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | yes |
| q235 A1 fixed-pd | ttft_p90_ms | tp8_ep8_mns128 | tp8_ep8_mns64 | 0.2% | 0.837x | 30.5% | 30.5% | 0.2% | 0.2% | no | COUNTEREXAMPLE | mns-axis | 0.2% | -0.2% | 0 | 0 | 0 | no |
| q235 A1 fixed-pd | tpot_mean_ms | tp8_ep8_mns128 | tp4_ep1_mns128 | 33.0% | 2.608x | 60.1% | 60.0% | 0.7% | 33.0% | yes | HOLDS | tp-axis | 28.5% | -60.1% | 1 | 0 | 1 | no |
| q235 A1 fixed-pd | tpot_p90_ms | tp8_ep8_mns128 | tp4_ep1_mns128 | 37.2% | 2.587x | 61.2% | 61.1% | 0.3% | 37.2% | yes | HOLDS | tp-axis | 31.6% | -61.1% | 1 | 0 | 1 | no |
| q235 A1 fixed-pd | e2e_mean_ms | tp8_ep8_mns128 | tp4_ep1_mns128 | 30.7% | 2.508x | 58.3% | 58.2% | 0.7% | 30.7% | yes | HOLDS | tp-axis | 26.8% | -58.3% | 1 | 0 | 1 | no |
| q235 A1 fixed-pd | e2e_p90_ms | tp8_ep8_mns128 | tp4_ep1_mns128 | 34.6% | 2.495x | 59.3% | 59.2% | 0.3% | 34.6% | yes | HOLDS | tp-axis | 29.7% | -59.2% | 1 | 0 | 1 | no |
| q235 A1 fixed-po | ttft_mean_ms | tp8_ep8_mns128 | tp8_ep8_mns128 | 0.0% | 0.776x | 24.8% | 24.8% | 0.2% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | yes |
| q235 A1 fixed-po | ttft_p90_ms | tp8_ep8_mns128 | tp8_ep8_mns128 | 0.0% | 0.757x | 28.9% | 28.9% | 0.3% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | yes |
| q235 A1 fixed-po | e2e_mean_ms | tp8_ep8_mns128 | tp8_ep8_mns128 | 0.0% | 0.776x | 24.8% | 24.8% | 0.2% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | yes |
| q235 A1 fixed-po | e2e_p90_ms | tp8_ep8_mns128 | tp8_ep8_mns128 | 0.0% | 0.757x | 28.9% | 28.9% | 0.3% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | yes |
| q235 A1 trace-pd | ttft_mean_ms | tp8_ep8_mns128 | tp8_ep8_mns128 | 0.0% | 1.217x | 154.4% | 154.4% | 2220.3% | 0.0% | no | HOLDS | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q235 A1 trace-pd | ttft_p90_ms | tp8_ep8_mns128 | tp8_ep8_mns128 | 0.0% | 1.219x | 151.1% | 151.1% | 3455.8% | 0.0% | no | HOLDS | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q235 A1 trace-pd | tpot_mean_ms | tp8_ep8_mns64 | tp8_ep8_mns64 | 0.0% | 1.338x | 46.7% | 28.2% | 16.8% | 0.0% | no | COUNTEREXAMPLE | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q235 A1 trace-pd | tpot_p90_ms | tp8_ep8_mns64 | tp8_ep8_mns64 | 0.0% | 1.221x | 45.3% | 22.3% | 26.3% | 0.0% | no | HOLDS | none | 0.0% | +0.0% | 0 | 0 | 0 | no |
| q235 A1 trace-pd | e2e_mean_ms | tp8_ep8_mns128 | tp8_ep8_mns64 | 0.6% | 1.430x | 48.8% | 48.8% | 0.6% | 0.6% | no | COUNTEREXAMPLE | mns-axis | 0.6% | -15.9% | 0 | 1 | 0 | no |
| q235 A1 trace-pd | e2e_p90_ms | tp8_ep8_mns128 | tp8_ep8_mns64 | 6.2% | 1.492x | 49.7% | 49.7% | 6.2% | 6.2% | yes | HOLDS | mns-axis | 6.0% | -17.4% | 0 | 1 | 0 | no |
| q235 A1 trace-po | ttft_mean_ms | tp8_ep8_mns64 | tp8_ep8_mns128 | 1.4% | 0.548x | 32.2% | 32.2% | 1.4% | 1.4% | no | COUNTEREXAMPLE | mns-axis | 1.4% | -1.4% | 0 | 1 | 0 | no |
| q235 A1 trace-po | ttft_p90_ms | tp8_ep8_mns128 | tp8_ep8_mns64 | 0.3% | 0.568x | 31.9% | 31.9% | 0.3% | 0.3% | no | COUNTEREXAMPLE | mns-axis | 0.3% | -0.3% | 0 | 0 | 0 | no |
| q235 A1 trace-po | e2e_mean_ms | tp8_ep8_mns64 | tp8_ep8_mns128 | 1.4% | 0.548x | 32.2% | 32.2% | 1.4% | 1.4% | no | COUNTEREXAMPLE | mns-axis | 1.4% | -1.4% | 0 | 1 | 0 | no |
| q235 A1 trace-po | e2e_p90_ms | tp8_ep8_mns128 | tp8_ep8_mns64 | 0.3% | 0.568x | 31.9% | 31.9% | 0.3% | 0.3% | no | COUNTEREXAMPLE | mns-axis | 0.3% | -0.3% | 0 | 0 | 0 | no |
## H-SCALE verdict
H-SCALE is not sufficient as stated; the following rows are counterexamples to the biconditional:
All 40 observed counterexamples are non-failures with spread > `log1p(margin)`; there are 0 failures with spread <= `log1p(margin)`. Thus the threshold is necessary for the observed failures but not sufficient to predict them.
| case | objective | failure | spread real top-3 | real margin | counterexample type |
|---|---|---|---:|---:|---|
| q30 trace-pd | ttft_mean_ms | no | 73.5% | 52.8% | non-failure with spread > log1p(margin) |
| q30 trace-pd | ttft_p90_ms | no | 136.8% | 67.6% | non-failure with spread > log1p(margin) |
| q30 trace-pd | e2e_mean_ms | no | 50.1% | 6.6% | non-failure with spread > log1p(margin) |
| q30 trace-pd | e2e_p90_ms | no | 70.3% | 0.1% | non-failure with spread > log1p(margin) |
| q30 fixed-pd high | tpot_mean_ms | no | 95.7% | 34.4% | non-failure with spread > log1p(margin) |
| q30 fixed-pd high | tpot_p90_ms | no | 95.1% | 37.2% | non-failure with spread > log1p(margin) |
| q30 fixed-pd high | e2e_mean_ms | no | 111.5% | 0.7% | non-failure with spread > log1p(margin) |
| q30 fixed-po high | ttft_mean_ms | no | 0.3% | 0.1% | non-failure with spread > log1p(margin) |
| q30 fixed-po high | ttft_p90_ms | no | 0.3% | 0.0% | non-failure with spread > log1p(margin) |
| q30 fixed-po high | e2e_mean_ms | no | 0.3% | 0.1% | non-failure with spread > log1p(margin) |
| q30 fixed-po high | e2e_p90_ms | no | 0.3% | 0.0% | non-failure with spread > log1p(margin) |
| q30 fixed-pd low | ttft_mean_ms | no | 1.5% | 1.3% | non-failure with spread > log1p(margin) |
| q30 fixed-pd low | ttft_p90_ms | no | 2.9% | 1.8% | non-failure with spread > log1p(margin) |
| q30 fixed-po low | ttft_mean_ms | no | 1.1% | 0.3% | non-failure with spread > log1p(margin) |
| q30 fixed-po low | ttft_p90_ms | no | 2.3% | 0.6% | non-failure with spread > log1p(margin) |
| q30 fixed-po low | e2e_mean_ms | no | 1.1% | 0.3% | non-failure with spread > log1p(margin) |
| q30 fixed-po low | e2e_p90_ms | no | 2.4% | 0.7% | non-failure with spread > log1p(margin) |
| q30 trace-po low | ttft_mean_ms | no | 2.6% | 1.7% | non-failure with spread > log1p(margin) |
| q30 trace-po low | ttft_p90_ms | no | 0.2% | 0.2% | non-failure with spread > log1p(margin) |
| q30 trace-po low | e2e_mean_ms | no | 2.6% | 1.7% | non-failure with spread > log1p(margin) |
| q30 trace-po low | e2e_p90_ms | no | 0.2% | 0.1% | non-failure with spread > log1p(margin) |
| q235 A0 fixed-pd | ttft_mean_ms | no | 5.0% | 0.4% | non-failure with spread > log1p(margin) |
| q235 A0 fixed-pd | ttft_p90_ms | no | 2.4% | 0.2% | non-failure with spread > log1p(margin) |
| q235 A0 fixed-po | ttft_p90_ms | no | 8.0% | 0.3% | non-failure with spread > log1p(margin) |
| q235 A0 fixed-po | e2e_p90_ms | no | 8.0% | 0.3% | non-failure with spread > log1p(margin) |
| q235 A0 trace-pd | tpot_mean_ms | no | 43.1% | 16.8% | non-failure with spread > log1p(margin) |
| q235 A0 trace-pd | tpot_p90_ms | no | 29.8% | 26.3% | non-failure with spread > log1p(margin) |
| q235 A0 trace-pd | e2e_mean_ms | no | 69.3% | 0.6% | non-failure with spread > log1p(margin) |
| q235 A1 fixed-pd | ttft_mean_ms | no | 26.8% | 0.4% | non-failure with spread > log1p(margin) |
| q235 A1 fixed-pd | ttft_p90_ms | no | 30.5% | 0.2% | non-failure with spread > log1p(margin) |
| q235 A1 fixed-po | ttft_mean_ms | no | 24.8% | 0.2% | non-failure with spread > log1p(margin) |
| q235 A1 fixed-po | ttft_p90_ms | no | 28.9% | 0.3% | non-failure with spread > log1p(margin) |
| q235 A1 fixed-po | e2e_mean_ms | no | 24.8% | 0.2% | non-failure with spread > log1p(margin) |
| q235 A1 fixed-po | e2e_p90_ms | no | 28.9% | 0.3% | non-failure with spread > log1p(margin) |
| q235 A1 trace-pd | tpot_mean_ms | no | 28.2% | 16.8% | non-failure with spread > log1p(margin) |
| q235 A1 trace-pd | e2e_mean_ms | no | 48.8% | 0.6% | non-failure with spread > log1p(margin) |
| q235 A1 trace-po | ttft_mean_ms | no | 32.2% | 1.4% | non-failure with spread > log1p(margin) |
| q235 A1 trace-po | ttft_p90_ms | no | 31.9% | 0.3% | non-failure with spread > log1p(margin) |
| q235 A1 trace-po | e2e_mean_ms | no | 32.2% | 1.4% | non-failure with spread > log1p(margin) |
| q235 A1 trace-po | e2e_p90_ms | no | 31.9% | 0.3% | non-failure with spread > log1p(margin) |
## S0b directional conclusions
Directional pair statistics remove the S0 range statistic's ambiguity by measuring every config against the real winner. Strict inversions use the frozen-value test `real_c > real_w and sim_c < sim_w`; simulator ties are not counted as inversions.
### (a) Which config axis decides each material failure?
| case | objective | real winner → sim winner | deciding axis | m_s | delta_s | -delta_s | regret |
|---|---|---|---|---:|---:|---:|---:|
| q30 fixed-pd high | ttft_mean_ms | tp4_mns32 → tp2_mns64 | mixed | 45.7% | -523.8% | 523.8% | 58.0% |
| q30 fixed-pd high | ttft_p90_ms | tp4_mns64 → tp2_mns64 | tp-axis | 44.6% | -435.3% | 435.3% | 56.2% |
| q30 fixed-pd high | e2e_p90_ms | tp1_mns32 → tp2_mns64 | mixed | 5.3% | -101.7% | 101.7% | 5.5% |
| q30 fixed-pd low | tpot_mean_ms | tp4_mns32 → tp1_mns16 | mixed | 13.1% | -52.5% | 52.5% | 14.0% |
| q30 fixed-pd low | tpot_p90_ms | tp4_mns8 → tp1_mns16 | mixed | 12.5% | -52.8% | 52.8% | 13.4% |
| q30 fixed-pd low | e2e_mean_ms | tp4_mns32 → tp1_mns16 | mixed | 23.8% | -59.6% | 59.6% | 26.9% |
| q30 fixed-pd low | e2e_p90_ms | tp4_mns8 → tp1_mns16 | mixed | 22.9% | -59.8% | 59.8% | 25.7% |
| q235 A0 fixed-pd | tpot_mean_ms | tp4_ep1_mns128 → tp8_ep8_mns128 | tp-axis | 28.5% | -64.0% | 64.0% | 33.0% |
| q235 A0 fixed-pd | tpot_p90_ms | tp4_ep1_mns128 → tp8_ep8_mns128 | tp-axis | 31.6% | -62.8% | 62.8% | 37.2% |
| q235 A0 fixed-pd | e2e_mean_ms | tp4_ep1_mns128 → tp8_ep8_mns128 | tp-axis | 26.8% | -61.5% | 61.5% | 30.7% |
| q235 A0 fixed-pd | e2e_p90_ms | tp4_ep1_mns128 → tp8_ep8_mns128 | tp-axis | 29.7% | -60.4% | 60.4% | 34.6% |
| q235 A0 fixed-po | ttft_mean_ms | tp8_ep8_mns128 → tp4_ep1_mns128 | tp-axis | 5.7% | -12.0% | 12.0% | 5.9% |
| q235 A0 fixed-po | e2e_mean_ms | tp8_ep8_mns128 → tp4_ep1_mns128 | tp-axis | 5.7% | -12.0% | 12.0% | 5.9% |
| q235 A0 trace-pd | e2e_p90_ms | tp8_ep8_mns64 → tp8_ep8_mns128 | mns-axis | 6.0% | -16.7% | 16.7% | 6.2% |
| q235 A0 trace-po | ttft_mean_ms | tp8_ep8_mns128 → tp4_ep1_mns64 | mixed | 6.8% | -36.3% | 36.3% | 7.0% |
| q235 A0 trace-po | ttft_p90_ms | tp8_ep8_mns64 → tp4_ep1_mns128 | mixed | 19.2% | -31.6% | 31.6% | 21.2% |
| q235 A0 trace-po | e2e_mean_ms | tp8_ep8_mns128 → tp4_ep1_mns64 | mixed | 6.8% | -36.3% | 36.3% | 7.0% |
| q235 A0 trace-po | e2e_p90_ms | tp8_ep8_mns64 → tp4_ep1_mns128 | mixed | 19.2% | -31.6% | 31.6% | 21.2% |
| q235 A1 fixed-pd | tpot_mean_ms | tp4_ep1_mns128 → tp8_ep8_mns128 | tp-axis | 28.5% | -60.1% | 60.1% | 33.0% |
| q235 A1 fixed-pd | tpot_p90_ms | tp4_ep1_mns128 → tp8_ep8_mns128 | tp-axis | 31.6% | -61.1% | 61.1% | 37.2% |
| q235 A1 fixed-pd | e2e_mean_ms | tp4_ep1_mns128 → tp8_ep8_mns128 | tp-axis | 26.8% | -58.3% | 58.3% | 30.7% |
| q235 A1 fixed-pd | e2e_p90_ms | tp4_ep1_mns128 → tp8_ep8_mns128 | tp-axis | 29.7% | -59.2% | 59.2% | 34.6% |
| q235 A1 trace-pd | e2e_p90_ms | tp8_ep8_mns64 → tp8_ep8_mns128 | mns-axis | 6.0% | -17.4% | 17.4% | 6.2% |
### (b) Where do TP-axis and MNS-axis inversions and boundary ties concentrate?
`n_inv_*` counts sum strict `(real winner, c)` pair inversions across all objectives in each case; a row can contain more than one inverted pair. `n_tie_*` counts cover exact simulator ties only for the simulator-selected winner versus the real winner. Ties remain decision-boundary winner-label mismatches, not strict reversals.
| case | n_inv_tp | n_inv_mns | n_inv_mixed | n_tie_tp | n_tie_mns | n_tie_mixed |
|---|---:|---:|---:|---:|---:|---:|
| q30 trace-pd | 0 | 0 | 0 | 0 | 0 | 0 |
| q30 fixed-pd high | 7 | 3 | 6 | 0 | 0 | 0 |
| q30 fixed-po high | 0 | 0 | 0 | 0 | 4 | 0 |
| q30 fixed-pd low | 8 | 0 | 24 | 0 | 0 | 0 |
| q30 fixed-po low | 0 | 0 | 0 | 0 | 4 | 0 |
| q30 trace-po low | 0 | 6 | 0 | 0 | 2 | 0 |
| q235 A0 fixed-pd | 5 | 0 | 5 | 0 | 1 | 0 |
| q235 A0 fixed-po | 4 | 0 | 4 | 0 | 0 | 0 |
| q235 A0 trace-pd | 0 | 2 | 0 | 0 | 0 | 0 |
| q235 A0 trace-po | 4 | 2 | 4 | 0 | 0 | 0 |
| q235 A1 fixed-pd | 4 | 0 | 4 | 0 | 1 | 0 |
| q235 A1 fixed-po | 0 | 0 | 0 | 0 | 0 | 0 |
| q235 A1 trace-pd | 0 | 2 | 0 | 0 | 0 | 0 |
| q235 A1 trace-po | 0 | 2 | 0 | 0 | 2 | 0 |
| **total** | **32** | **17** | **47** | **0** | **14** | **0** |
- Among strict inversions, TP-axis cases are most concentrated in: q30 fixed-pd low (8), q30 fixed-pd high (7), q235 A0 fixed-pd (5), q235 A0 fixed-po (4), q235 A0 trace-po (4).
- Among strict inversions, MNS-axis cases are most concentrated in: q30 trace-po low (6), q30 fixed-pd high (3), q235 A0 trace-pd (2), q235 A0 trace-po (2), q235 A1 trace-pd (2).
- The eight Q235 A0/A1 Fixed-PD failures are all tp-axis. This does not conflict with the A0/MNS64 state-drift diagnosis, but does not constitute additional state-drift evidence for A1/MNS128.
- Q30 admission evidence does not map one-to-one to an MNS-axis deciding pair: high-pressure Fixed-PD TTFT mean is **mixed** and p90 is **tp-axis**. This is an axis/mechanism mismatch, not a direct causal contradiction: changing TP changes offered arrival pressure, while the diagnosed nonlinear event is crossing the MNS admission cap. It rules out the simpler claim that an MNS-threshold mechanism must appear as an mns-axis winner pair.
- All 14 exact simulator winner ties are mns-axis. Including these boundary errors gives MNS **17 + 14 = 31**, comparable to TP's **32** strict inversions.
The exact ties below show that Frontier is completely insensitive to MNS changes within the corresponding case/objective cell:
| case | objective | real winner ↔ simulator-selected tied winner (MNS pair) |
|---|---|---|
| q30 fixed-po high | ttft_mean_ms | tp4_mns32 ↔ tp4_mns16 |
| q30 fixed-po high | ttft_p90_ms | tp4_mns32 ↔ tp4_mns16 |
| q30 fixed-po high | e2e_mean_ms | tp4_mns32 ↔ tp4_mns16 |
| q30 fixed-po high | e2e_p90_ms | tp4_mns32 ↔ tp4_mns16 |
| q30 fixed-po low | ttft_mean_ms | tp4_mns8 ↔ tp4_mns16 |
| q30 fixed-po low | ttft_p90_ms | tp4_mns8 ↔ tp4_mns16 |
| q30 fixed-po low | e2e_mean_ms | tp4_mns8 ↔ tp4_mns16 |
| q30 fixed-po low | e2e_p90_ms | tp4_mns8 ↔ tp4_mns16 |
| q30 trace-po low | ttft_p90_ms | tp4_mns8 ↔ tp4_mns16 |
| q30 trace-po low | e2e_p90_ms | tp4_mns8 ↔ tp4_mns16 |
| q235 A0 fixed-pd | ttft_p90_ms | tp8_ep8_mns64 ↔ tp8_ep8_mns128 |
| q235 A1 fixed-pd | ttft_p90_ms | tp8_ep8_mns64 ↔ tp8_ep8_mns128 |
| q235 A1 trace-po | ttft_p90_ms | tp8_ep8_mns64 ↔ tp8_ep8_mns128 |
| q235 A1 trace-po | e2e_p90_ms | tp8_ep8_mns64 ↔ tp8_ep8_mns128 |
### (c) How many exact-winner successes are margin-robust?
Among exact winner matches, **17** are margin-robust (`margin >= 1%`) and **6** are fragile (`margin < 1%`). Separately, 14 winner-label mismatches come from exact simulator ties and sit on the decision boundary rather than being strict inversions.
| fragile-success case | objective | real margin |
|---|---|---:|
| q30 trace-pd | e2e_p90_ms | 0.1% |
| q235 A1 fixed-pd | ttft_mean_ms | 0.4% |
| q235 A1 fixed-po | ttft_mean_ms | 0.2% |
| q235 A1 fixed-po | ttft_p90_ms | 0.3% |
| q235 A1 fixed-po | e2e_mean_ms | 0.2% |
| q235 A1 fixed-po | e2e_p90_ms | 0.3% |
## Cross-checks
| check | observed | frozen expectation | result |
|---|---:|---:|---|
| q30 high-pressure fixed-pd TTFT mean regret | 58.0% | 58.0% | PASS |
| q235 A0 fixed-pd TPOT mean regret | 33.0% | 33.0% | PASS |
| q235 A1 fixed-pd TPOT mean regret | 33.0% | 33.0% | PASS |
| q30 trace-pd all-objective regret | 0.0%, 0.0%, 0.0%, 0.0%, 0.0%, 0.0% | 0.0%, 0.0%, 0.0%, 0.0%, 0.0%, 0.0% | PASS |
| q235 Trace-PO TTFT p90 A0 to A1 regret | 21.2%, 0.3% | 21.2%, 0.3% | PASS |
| q235 Fixed-PD TPOT/E2E regrets unchanged from A0 to A1 | 33.0%, 37.2%, 30.7%, 34.6%, 33.0%, 37.2%, 30.7%, 34.6% | 33.0%, 37.2%, 30.7%, 34.6%, 33.0%, 37.2%, 30.7%, 34.6% | PASS |
## Data gaps
No per-config sim/real pairing gaps were found in the requested surfaces.
## 异常
- 无。重算 winner/regret 与 frozen JSON 一致,硬性交叉核对均通过。
## Figure
`margin-vs-residual.png` uses x = `100 × log1p(real best-vs-second relative margin)` and y = `100 ×` real-top-3 log-ratio spread. Both axes are logarithmic because the real margins span six orders of magnitude. Green means exact winner match; red means winner mismatch. The diagonal is the H-SCALE threshold, while failure itself is defined by regret, not by exact winner match.
`decision-pair-axis.png` is a mechanism census, not a hypothesis test: for a strict winner reversal, `-delta_s > m_s` is algebraically equivalent to the mismatch. The frozen surfaces also contain deterministic winner-label mismatches caused by exact simulator ties; those points lie on `-delta_s = m_s` and are not counted as strict inversions. Color identifies the winner-deciding config axis and marker area is proportional to regret.
## A0 vs A1 对照
A1 repairs the Q235 Trace-PO p90 ranking error but leaves the four large Fixed-PD TPOT/E2E regrets unchanged.
| case / objective | A0 regret | A1 regret |
|---|---:|---:|
| trace-po / ttft_p90_ms | 21.2% | 0.3% |
| fixed-pd / tpot_mean_ms | 33.0% | 33.0% |
| fixed-pd / tpot_p90_ms | 37.2% | 37.2% |
| fixed-pd / e2e_mean_ms | 30.7% | 30.7% |
| fixed-pd / e2e_p90_ms | 34.6% | 34.6% |
Thus Trace-PO TTFT p90 changes **21.2% → 0.3%**, whereas Fixed-PD remains **33.0% / 37.2% / 30.7% / 34.6%** in both A0 and A1.
## 已知分量归因摘要
### Q30 high-pressure Fixed-PD TTFT: first-scheduling wait vs execution-side TTFT
`queue-free TTFT` is the execution-side TTFT after removing first-scheduling wait; in the frozen diagnostic, simulated TTFT is their sum (up to floating-point rounding).
| config | sim TPOT / real | sim slots / MNS | real slots upper / MNS | first-scheduling wait | queue-free TTFT | sim TTFT | real TTFT | real waiting max |
|---|---:|---:|---:|---:|---:|---:|---:|---:|
| tp2_mns64 | 8.09x | 58.0/64 | 7.5/64 | 38.2 ms | 191.0 ms | 229.3 ms | 194.6 ms | 0 |
| tp4_mns16 | 3.83x | 54.5/16 | 14.6/16 | 64906.3 ms | 134.7 ms | 65041.0 ms | 124.5 ms | 0 |
| tp4_mns32 | 4.67x | 65.9/32 | 14.5/32 | 27180.7 ms | 135.6 ms | 27316.3 ms | 123.2 ms | 0 |
| tp4_mns64 | 5.61x | 79.8/64 | 14.7/64 | 6367.3 ms | 136.7 ms | 6504.0 ms | 123.2 ms | 0 |
For TP4/MNS32 minus TP2/MNS64, the observed simulator contrast is **+27087.0 ms**; removing first-scheduling wait changes it to **-55.4 ms**, aligned with the real contrast **-71.4 ms**. This localizes the Q30 high-pressure TTFT reversal to admission queueing, while the upstream service-time overprediction remains unattributed in the frozen data.
### Q235 Fixed-PD: own-composition vs exact-state contrast
Positive TP8TP4 means TP8 is slower and therefore agrees with the real TP4 winner.
| config | sim own decode batch mean | real exact decode batch mean | real token-weighted iteration | exact-state matched sim | coverage |
|---|---:|---:|---:|---:|---:|
| tp4_ep1_mns64 | 13.537 | 3.890 | 18.4710 ms | 34.2575 ms | 100.0% |
| tp8_ep8_mns64 | 18.938 | 10.921 | 27.5887 ms | 45.1603 ms | 100.0% |
| component | own-composition TP8TP4 | exact-state TP8TP4 |
|---|---:|---:|
| total | -20.0663 ms | +10.9028 ms |
| moe_compute | -32.4544 ms | -1.9774 ms |
| attention | -7.4619 ms | -2.1304 ms |
| tp_dp_communication | -6.5711 ms | -6.4718 ms |
| ep_communication | +6.2354 ms | +6.5355 ms |
| moe_routing | -0.2862 ms | +0.1384 ms |
| dense_mlp_compute | -0.1231 ms | -0.0308 ms |
| pipeline_communication | +0.0000 ms | +0.0000 ms |
| runtime_overhead | +0.0000 ms | +0.0000 ms |
The total contrast flips from **-20.0663 ms** on Frontier's own composition to **+10.9028 ms** at exact real state, a **+30.9690 ms** state-composition shift. The exact real iteration contrast is **+9.1177 ms** and the frozen real TPOT contrast is **+6.9500 ms**. This supports closed-loop state/composition drift for Q235 Fixed-PD; it does not by itself attribute every remaining conditional execution residual.

Binary file not shown.

After

Width:  |  Height:  |  Size: 218 KiB