Files
aituner/runs/frontier-multicase-sufficiency-v0/results/ground-truth/report.md

2.8 KiB

Qwen235B ground-truth audit

Objective: maximum SLO-feasible offered request throughput per GPU. This report contains real-machine data only; it makes no Frontier match claim.

case valid cells score levels top-set size random top-set hit informative pairs
qwen235b_prefill_only 8/8 3 4/8 50.0% 20/28 (71.4%)
qwen235b_decode_only 7/8 2 5/8 62.5% 15/28 (53.6%)

Cells

qwen235b_prefill_only

cell capacity bracket (req/s/GPU) valid probes source
tp4_mns128_mbt16384 [0.106666667, 0.117500000) yes 6 primary_search
tp4_mns128_mbt8192 [0.117500000, 0.133333333) yes 6 primary_search
tp4_mns64_mbt16384 [0.106666667, 0.117500000) yes 6 primary_search
tp4_mns64_mbt8192 [0.117500000, 0.133333333) yes 6 primary_search
tp8_mns128_mbt16384 [0.172708333, 0.177916667) yes 6 primary_search
tp8_mns128_mbt8192 [0.172708333, 0.177916667) yes 6 primary_search
tp8_mns64_mbt16384 [0.172708333, 0.177916667) yes 6 primary_search
tp8_mns64_mbt8192 [0.172708333, 0.177916667) yes 6 primary_search

Top set: tp8_mns128_mbt16384, tp8_mns128_mbt8192, tp8_mns64_mbt16384, tp8_mns64_mbt8192. Possibly optimal under binary-search brackets: tp8_mns128_mbt16384, tp8_mns128_mbt8192, tp8_mns64_mbt16384, tp8_mns64_mbt8192.

qwen235b_decode_only

cell capacity bracket (req/s/GPU) valid probes source
tp2_dp4_ep8_mns128_mbt256 [0.058958333, 0.066875000) yes 6 primary_search
tp2_dp4_ep8_mns128_mbt384 [0.058958333, 0.066875000) no 6 partial_probe_before_failure
tp2_dp4_ep8_mns64_mbt256 [0.058958333, 0.066875000) yes 6 primary_search
tp2_dp4_ep8_mns64_mbt384 [0.053541667, 0.058958333) yes 6 primary_search
tp4_dp2_ep8_mns128_mbt256 [0.058958333, 0.066875000) yes 6 primary_search
tp4_dp2_ep8_mns128_mbt384 [0.058958333, 0.066875000) yes 6 primary_search
tp4_dp2_ep8_mns64_mbt256 [0.053541667, 0.058958333) yes 6 primary_search
tp4_dp2_ep8_mns64_mbt384 [0.053541667, 0.058958333) yes 6 primary_search

Top set: tp2_dp4_ep8_mns128_mbt256, tp2_dp4_ep8_mns128_mbt384, tp2_dp4_ep8_mns64_mbt256, tp4_dp2_ep8_mns128_mbt256, tp4_dp2_ep8_mns128_mbt384. Possibly optimal under binary-search brackets: tp2_dp4_ep8_mns128_mbt256, tp2_dp4_ep8_mns128_mbt384, tp2_dp4_ep8_mns64_mbt256, tp2_dp4_ep8_mns64_mbt384, tp4_dp2_ep8_mns128_mbt256, tp4_dp2_ep8_mns128_mbt384, tp4_dp2_ep8_mns64_mbt256, tp4_dp2_ep8_mns64_mbt384.

Interpretation guardrail

A Frontier top-set hit is insufficient by itself because the surfaces contain large ties. The later comparison must report selected-config regret and tie-aware pairwise ranking, and must keep invalid real cells visible.