Gahow Wang 2e6a369046 PD_DISAGG_RESULTS §5.1: D-pool pressure crashes consumers ...

Document the consumer EngineCore crash chain (D-pool 97% -> 112k-token
KV transfer fails -> negative prompt-token counter -> prometheus
ValueError -> engine dead -> cliff failure). Explains the round-robin
6P+2D rep variance (100/56/80%) as intermittent consumer death, and
notes the counter-clamp patch needed to compare routing arms fairly.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

2026-05-28 13:02:21 +08:00

..

aggregate_mb5.py

MB5 analysis: per-role KV split proves static-partition mismatch

2026-05-28 12:05:17 +08:00

analyze_mb1.py

MB1: prefill-decode interference under chunked-prefill default; §3.2 headline

2026-05-27 21:25:09 +08:00

analyze_mb2_send_only.py

MB2 inter-node: dash1↔dash2 transfer cost is identical to intra-node

2026-05-27 20:56:08 +08:00

analyze_mb2.py

MB2: pure KV-transfer cost on dash1 intra-node — Mooncake ~9.7 GB/s steady

2026-05-27 19:04:03 +08:00

deploy.sh

MB5 driver: launcher, orchestrator, KV-pool timeline plotter

2026-05-27 23:02:57 +08:00

install.sh

Phase 0: fresh vllm 0.18.1 + mooncake-transfer-engine on dash1/dash2

2026-05-27 17:42:36 +08:00

instrument_kv_snapshot.py

MB5 patch: clamp PD-consumer metrics counter underflow

2026-05-28 13:01:23 +08:00

instrument_mooncake.py

MB2: working end-to-end intra-node KV transfer microbench

2026-05-27 18:53:25 +08:00

mb1_driver.py

MB1: prefill-decode interference under chunked-prefill default; §3.2 headline

2026-05-27 21:25:09 +08:00

mb1_launch.sh

MB1: prefill-decode interference under chunked-prefill default; §3.2 headline

2026-05-27 21:25:09 +08:00

mb2_kv_transfer.py

MB2 inter-node scaffolding: per-host single-instance launcher + client host args

2026-05-27 20:26:54 +08:00

mb5_launch.sh

MB5 proxy: session-affinity P routing (MB5_P_ROUTING=session)

2026-05-28 11:05:25 +08:00

mb5_pd_proxy.py

MB5 proxy: session-affinity P routing (MB5_P_ROUTING=session)

2026-05-28 11:05:25 +08:00

mb5_run.sh

MB5 driver fixes: bash env-prefix + replayer flag names + python date math

2026-05-27 23:23:23 +08:00

PD_DISAGG_INVESTIGATION.md

PD_DISAGG_INVESTIGATION: snapshot Phase 0 done + sweep in flight

2026-05-28 00:51:28 +08:00

PD_DISAGG_RESULTS.md

PD_DISAGG_RESULTS §5.1: D-pool pressure crashes consumers

2026-05-28 13:02:21 +08:00

plot_kv_pool_timeline.py

MB5 PD-disagg pipeline: working end-to-end

2026-05-28 00:14:22 +08:00

plot_mb1.py

Correct PD-disagg cost/benefit framing across repo

2026-05-27 22:04:49 +08:00

plot_mb2_compare.py

MB2 inter-node: dash1↔dash2 transfer cost is identical to intra-node

2026-05-27 20:56:08 +08:00

plot_mb2.py

MB2 inter-node: dash1↔dash2 transfer cost is identical to intra-node

2026-05-27 20:56:08 +08:00

start_vllm_pair.sh

MB2: working end-to-end intra-node KV transfer microbench

2026-05-27 18:53:25 +08:00

start_vllm_single.sh

MB2 inter-node scaffolding: per-host single-instance launcher + client host args

2026-05-27 20:26:54 +08:00