Gahow Wang e532e83d3e mb5_run: scrape per-instance prefix-cache counters before teardown ...

Per-port vllm:prefix_cache_{queries,hits}_total -> instance_apc.txt. For PD
this is the only honest reuse signal: producer ports show cross-turn prefix
hits, while the consumer's per-request cached_tokens just counts transferred KV.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-05-29 11:56:43 +08:00

..

connector_tax

Engine-state ablation: full sweep harness + results

2026-05-29 11:55:49 +08:00

fresh_setup

mb5_run: scrape per-instance prefix-cache counters before teardown

2026-05-29 11:56:43 +08:00

interference

Microbench 1 plots: prefill-decode interference heatmap + lines

2026-05-26 14:21:30 +08:00

lifecycle

PD-sep server-side profiling: vLLM patches + per-request breakdown

2026-05-26 13:59:09 +08:00

patches

PD-sep server-side profiling: vLLM patches + per-request breakdown

2026-05-26 13:59:09 +08:00

__init__.py

Microbench 3 (connector_tax): infrastructure for KV connector substrate tax

2026-05-26 17:27:41 +08:00

ANALYSIS.md

Microbench: prefill-decode interference + PD transfer lifecycle

2026-05-26 00:57:06 +08:00

interference_microbench_design.md

Microbench: prefill-decode interference + PD transfer lifecycle

2026-05-26 00:57:06 +08:00

plot_breakdown_real.py

PD-sep server-side profiling: vLLM patches + per-request breakdown

2026-05-26 13:59:09 +08:00

plot_breakdown.py

PD-sep server-side profiling: vLLM patches + per-request breakdown

2026-05-26 13:59:09 +08:00

plot_interference.py

Microbench 1 plots: prefill-decode interference heatmap + lines

2026-05-26 14:21:30 +08:00

TODO.md

Microbench: prefill-decode interference + PD transfer lifecycle

2026-05-26 00:57:06 +08:00

transfer_lifecycle_design.md

Microbench: prefill-decode interference + PD transfer lifecycle

2026-05-26 00:57:06 +08:00