11 lines
495 B
Markdown
11 lines
495 B
Markdown
# Qwen30 Frontier vs real latency selection
|
|
|
|
| Objective | Frontier | Real | Match | Regret | Pairwise |
|
|
|---|---|---|---:|---:|---:|
|
|
| ttft_ms:mean | tp2_mns64 | tp4_mns32 | no | 58.0% | 59.1% |
|
|
| ttft_ms:p90 | tp2_mns64 | tp4_mns64 | no | 56.2% | 59.1% |
|
|
| tpot_ms:mean | tp4_mns8 | tp4_mns8 | yes | 0.0% | 48.5% |
|
|
| tpot_ms:p90 | tp4_mns8 | tp4_mns8 | yes | 0.0% | 42.4% |
|
|
| e2e_ms:mean | tp4_mns64 | tp1_mns32 | no | 1.7% | 51.5% |
|
|
| e2e_ms:p90 | tp2_mns64 | tp1_mns32 | no | 5.5% | 51.5% |
|