gahow/aituner
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
788270183da01f3ef3ca6d44f4bb8bd083a6fbb2
aituner/runs/frontier-split-rootcause-v0/frozen-inputs/q30-expansion-lo/fixed-pd-comparison.md
Gahow Wang 39766141fb Decompose good/bad selection split across frozen surfaces 
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-20 12:05:20 +08:00

497 B
Raw Blame History

Qwen30 Frontier vs real latency selection

Objective Frontier Real Match Regret Pairwise
ttft_ms:mean tp4_mns16 tp4_mns16 yes 0.0% 100.0%
ttft_ms:p90 tp4_mns16 tp4_mns16 yes 0.0% 100.0%
tpot_ms:mean tp1_mns16 tp4_mns32 no 14.0% 0.0%
tpot_ms:p90 tp1_mns16 tp4_mns8 no 13.4% 0.0%
e2e_ms:mean tp1_mns16 tp4_mns32 no 26.9% 0.0%
e2e_ms:p90 tp1_mns16 tp4_mns8 no 25.7% 0.0%