389 B
389 B
Qwen30 real latency case audit
Prefill-only: False.
| Objective | Real winner | Value (ms) |
|---|---|---|
| ttft_ms:pooled_mean_ms | tp4_mns16 | 63.04 |
| ttft_ms:pooled_p90_ms | tp4_mns16 | 66.42 |
| tpot_ms:pooled_mean_ms | tp4_mns32 | 4.25 |
| tpot_ms:pooled_p90_ms | tp4_mns8 | 4.27 |
| e2e_ms:pooled_mean_ms | tp4_mns32 | 604.41 |
| e2e_ms:pooled_p90_ms | tp4_mns8 | 610.01 |