Gahow Wang 2e6a369046 PD_DISAGG_RESULTS §5.1: D-pool pressure crashes consumers ...

Document the consumer EngineCore crash chain (D-pool 97% -> 112k-token
KV transfer fails -> negative prompt-token counter -> prometheus
ValueError -> engine dead -> cliff failure). Explains the round-robin
6P+2D rep variance (100/56/80%) as intermittent consumer death, and
notes the counter-clamp patch needed to compare routing arms fairly.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>

2026-05-28 13:02:21 +08:00

..

connector_tax

Connector tax: trace-replay confirms +45% kv_both penalty is gone; DR-fix adds 22% more

2026-05-27 09:13:50 +08:00

fresh_setup

PD_DISAGG_RESULTS §5.1: D-pool pressure crashes consumers

2026-05-28 13:02:21 +08:00

interference

Microbench 1 plots: prefill-decode interference heatmap + lines

2026-05-26 14:21:30 +08:00

lifecycle

PD-sep server-side profiling: vLLM patches + per-request breakdown

2026-05-26 13:59:09 +08:00

patches

PD-sep server-side profiling: vLLM patches + per-request breakdown

2026-05-26 13:59:09 +08:00

__init__.py

Microbench 3 (connector_tax): infrastructure for KV connector substrate tax

2026-05-26 17:27:41 +08:00

ANALYSIS.md

Microbench: prefill-decode interference + PD transfer lifecycle

2026-05-26 00:57:06 +08:00

interference_microbench_design.md

Microbench: prefill-decode interference + PD transfer lifecycle

2026-05-26 00:57:06 +08:00

plot_breakdown_real.py

PD-sep server-side profiling: vLLM patches + per-request breakdown

2026-05-26 13:59:09 +08:00

plot_breakdown.py

PD-sep server-side profiling: vLLM patches + per-request breakdown

2026-05-26 13:59:09 +08:00

plot_interference.py

Microbench 1 plots: prefill-decode interference heatmap + lines

2026-05-26 14:21:30 +08:00

TODO.md

Microbench: prefill-decode interference + PD transfer lifecycle

2026-05-26 00:57:06 +08:00

transfer_lifecycle_design.md

Microbench: prefill-decode interference + PD transfer lifecycle

2026-05-26 00:57:06 +08:00