agentic-kvc

Go to file

Gahow Wang 795edc6c66 Overnight work report: routing optimization achieves +4.7pp APC

Summary of overnight autonomous session:
- Analyzed agentic workload patterns (91% KV reuse is intra-session)
- Simulated cache policies (LRU near-optimal, routing is the bottleneck)
- Implemented hybrid routing (session-sticky + load-aware override)
- Result: APC 44.7% -> 49.4% with zero latency regression

Key insight: routing quality > cache policy > PD separation for
single-machine agentic workloads.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-05-22 02:54:48 +08:00

analysis

Overnight work report: routing optimization achieves +4.7pp APC

2026-05-22 02:54:48 +08:00

patches

Add vLLM patches directory for version-controlled patch management

2026-05-22 00:26:14 +08:00

replayer

Balanced session-sticky routing + agentic workload pattern analysis

2026-05-22 01:50:27 +08:00

scripts

Hybrid routing: session-sticky + load-aware override achieves best results