Gahow Wang b2ede1da77 bench.sh: add trap for graceful cleanup on kill/interrupt ...

Added EXIT/INT/TERM traps to ensure vLLM, proxy, and gpu_monitor
processes are cleaned up even when bench.sh is killed externally.
Also includes gpu_monitor in cleanup_gpu pattern matching.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-05-23 20:24:13 +08:00

analysis

Add comprehensive research findings document

2026-05-23 07:16:31 +08:00

experiments

Add elastic PS evaluation plan for production-realistic trace

2026-05-23 15:56:05 +08:00

patches

Add vLLM patches directory for version-controlled patch management

2026-05-22 00:26:14 +08:00

replayer

Fix replay methodology: trace-driven dispatch, no artificial limits

2026-05-23 12:43:41 +08:00

scripts

bench.sh: add trap for graceful cleanup on kill/interrupt

2026-05-23 20:24:13 +08:00

third_party/vllm

Partial remote prefill: C_s exports cache, D computes new tokens locally

2026-05-23 20:04:13 +08:00

.gitignore

Phase 1 milestone: system-level analysis + reproducible report

2026-05-22 16:17:41 +08:00

pyproject.toml

Agentic workload PD separation analysis with trace-driven benchmarks

2026-05-21 21:21:57 +08:00

REPORT.md

Elastic PS eval: near-neutral, offload gate triggers only 14% of HEAVY

2026-05-23 16:49:25 +08:00

TODO.md

LMetric routing policy (OSDI'26) + A/B results vs linear baseline

2026-05-22 16:57:32 +08:00

Description

No description provided

48 MiB

Languages

Python 82.9%

Shell 17.1%