Gahow Wang fefbd71ca9 GPU imbalance analysis + elastic PS verdict + corrected LMetric results ...

Key findings:
- Session-sticky imbalance is 8.6x at 200 req (small-sample artifact)
  but only 1.24x at 1000 req (moderate, TPOT unaffected)
- Elastic PS not justified: interference reduction 0% at 1/GPU,
  migration reduces imbalance 1.24x→1.18x at 1.5s/event cost
- Corrected LMetric (no affinity) matches Linear (sticky) on all
  metrics (<2%), proving soft affinity from cache-hit scoring works
- Updated §3.4 errata, added §8 GPU imbalance + elastic PS analysis

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-05-23 12:11:23 +08:00

analysis

Add comprehensive research findings document

2026-05-23 07:16:31 +08:00

patches

Add vLLM patches directory for version-controlled patch management

2026-05-22 00:26:14 +08:00

replayer

Elastic P2P offload: TTFT p50 -49% vs baseline (0.551 vs 1.080)

2026-05-22 13:50:25 +08:00

scripts

Fix LMetric routing: remove session affinity, align with OSDI'26 spec

2026-05-23 11:56:58 +08:00

third_party/vllm

PS experiments + H4 cache-gate + GPU profiling + Mooncake elif→if fix

2026-05-23 02:14:37 +08:00

.gitignore

Phase 1 milestone: system-level analysis + reproducible report

2026-05-22 16:17:41 +08:00

pyproject.toml

Agentic workload PD separation analysis with trace-driven benchmarks

2026-05-21 21:21:57 +08:00

REPORT.md

GPU imbalance analysis + elastic PS verdict + corrected LMetric results

2026-05-23 12:11:23 +08:00

TODO.md

LMetric routing policy (OSDI'26) + A/B results vs linear baseline

2026-05-22 16:57:32 +08:00

Description

No description provided

48 MiB

Languages

Python 82.9%

Shell 17.1%