Gahow Wang
020a5c79a7
User pointed out the apparent paradox: in fig_b3_per_worker_ttft_p90, unified has hotspot index 3.67 while sticky has 2.73, yet unified e2e p90 is roughly half of sticky's. Resolution: hotspot index (max/median) is a *ratio* and misleading on its own. Per-worker absolute TTFT p90: sticky : median 20.3s, max 55.4s -> system e2e p90 34.6s unified: median 10.3s, max 37.7s -> system e2e p90 18.0s Mechanism: top 1% sessions own 46.5% input mass and there are more hot sessions than instances (8), so sticky's hash binding gives *every* worker its own hot session and the median worker is also slow. Unified's LMetric fallback re-routes cold/new sessions away from hot affinity instances, preserving 7/8 worker speed. System p90 is dominated by the majority of requests landing on fast workers, hence the 2x e2e gap. Changes: - Replace §3.3 figure with figs/f4c_per_worker_ttft.png (per-worker bars) instead of figs/f4c_apc_vs_hotspot_tradeoff.png (the ratio scatter) - §3.3 narrative in PAPER_OUTLINE.md and MEETING.md rewritten around absolute median + max + system e2e p90 instead of hotspot ratio - Add a §3.3 sub-finding: "hot pin failure must be measured with per-worker absolute latency, not normalized ratio" - Keep the scatter as supplementary for §5 multi-policy summary Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>