13 lines
389 B
Markdown
13 lines
389 B
Markdown
# Qwen30 real latency case audit
|
|
|
|
Prefill-only: `False`.
|
|
|
|
| Objective | Real winner | Value (ms) |
|
|
|---|---|---:|
|
|
| ttft_ms:pooled_mean_ms | tp4_mns16 | 63.04 |
|
|
| ttft_ms:pooled_p90_ms | tp4_mns16 | 66.42 |
|
|
| tpot_ms:pooled_mean_ms | tp4_mns32 | 4.25 |
|
|
| tpot_ms:pooled_p90_ms | tp4_mns8 | 4.27 |
|
|
| e2e_ms:pooled_mean_ms | tp4_mns32 | 604.41 |
|
|
| e2e_ms:pooled_p90_ms | tp4_mns8 | 610.01 |
|