495 B
495 B
Qwen30 Frontier vs real latency selection
| Objective | Frontier | Real | Match | Regret | Pairwise |
|---|---|---|---|---|---|
| ttft_ms:mean | tp2_mns64 | tp4_mns32 | no | 58.0% | 59.1% |
| ttft_ms:p90 | tp2_mns64 | tp4_mns64 | no | 56.2% | 59.1% |
| tpot_ms:mean | tp4_mns8 | tp4_mns8 | yes | 0.0% | 48.5% |
| tpot_ms:p90 | tp4_mns8 | tp4_mns8 | yes | 0.0% | 42.4% |
| e2e_ms:mean | tp4_mns64 | tp1_mns32 | no | 1.7% | 51.5% |
| e2e_ms:p90 | tp2_mns64 | tp1_mns32 | no | 5.5% | 51.5% |