11 lines
293 B
Markdown
11 lines
293 B
Markdown
# Qwen30 real latency case audit
|
|
|
|
Prefill-only: `True`.
|
|
|
|
| Objective | Real winner | Value (ms) |
|
|
|---|---|---:|
|
|
| ttft_ms:pooled_mean_ms | tp4_mns8 | 64.28 |
|
|
| ttft_ms:pooled_p90_ms | tp4_mns8 | 67.95 |
|
|
| e2e_ms:pooled_mean_ms | tp4_mns8 | 64.33 |
|
|
| e2e_ms:pooled_p90_ms | tp4_mns8 | 67.99 |
|