gahow/aituner
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
9c34650746f9c881cef7bc5c1a851aeb37636ea8
aituner/runs/frontier-multicase-sufficiency-v0/results/qwen30-baseline/report.md

706 B
Raw Blame History

Qwen30B Frontier baseline audit

mode selected cells worst real regret Kendall tau-b pair sign accuracy feasibility (agree/FP/FN)
uncalibrated/SLO-gated tp4_mns32, tp4_mns64 25.63% 0.0000 37.88% 37/0/55
frozen-calibrated/SLO-gated tp2_mns32, tp2_mns64 0.76% 0.9668 93.94% 64/21/7

The calibrated mode applies a distinct end-to-end execution-time scale per TP: TP1=0.723481, TP2=0.468089, TP4=0.352137.

Those scales were fitted against real total throughput on coder_200_ts2 and checked without refitting on coder_200_ts3. This validates within-workload transfer of the calibration, not zero-shot Frontier prediction across TP.