Gahow Wang 54e1f5266a MB5 PD ablation v2 results: concurrency axis + reuse 3-way writeup ...

- fig3_conc32k.json + fig3_concurrency_axis.png: agentic-corner concurrency
  sweep (in=32768, reuse=0.984, out=128), N 8->128, PD capped 600s / colo
  uncapped. colo completes 100% at every N (graceful, E2E 2.4s->81s); every
  static PD split collapses, earlier as N rises (viable only N<=16; <27% by N=32).
- analysis/mb5_pd_ablation/README.md: self-contained v2 writeup. Reuse axis
  3-way (A=d2048/o256, C=d2048/o128, B=d1024/o128) decomposes shape: output
  ~negligible, delta (real prefill/turn) dominant; crossover to colo at reuse
  ~90-95% robust. Run on dash2 (dash0 NICs faulted for Mooncake).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-06-01 09:35:25 +08:00

..

characterization

Add chatbot T_external CDF; overlay on f3a vs agentic

2026-05-27 14:49:44 +08:00

crossover

PD-disagg crossover: regular synthetic trace + goodput sweep + figure

2026-05-29 18:19:23 +08:00

mb1

Correct PD-disagg cost/benefit framing across repo

2026-05-27 22:04:49 +08:00

mb2

Correct PD-disagg cost/benefit framing across repo

2026-05-27 22:04:49 +08:00

mb5

PD_DISAGG_RESULTS §6.3: producer hot-pinning figure

2026-05-29 00:38:20 +08:00

mb5_pd_ablation

MB5 PD ablation v2 results: concurrency axis + reuse 3-way writeup

2026-06-01 09:35:25 +08:00

migration_trigger_validation

Migration trigger validation: unified_v4 fires at 2x QPS, not at 1x

2026-05-30 15:36:58 +08:00

pd_sep_paper_section

PD-sep matrix results: C2/C3/C4 figures + empirical mechanism refined

2026-05-25 16:23:52 +08:00

v2

v2: linear (default cache-aware) baseline + 2x wall-cap on first600s

2026-06-01 00:55:40 +08:00

working_set

Working-set sizing tool + GLM-5.1-FP8/B300 result

2026-05-28 16:03:25 +08:00

workload_chars

Workload characterization C1-C3 on full production trace

2026-05-29 18:19:39 +08:00

adaptive_prefill_offload_design.md

Design doc: Adaptive Prefill Offload

2026-05-22 00:44:22 +08:00

agentic_pd_unified_story_plan.md

Agentic PD / Unified routing story plan draft

2026-05-26 01:12:42 +08:00

characterization_todo_for_interns.md

Audit package refresh: Window 1 supported claims + risk register

2026-05-25 23:25:27 +08:00

claude_characterization_work_plan.md

Characterization plan: progress snapshot + Claude work plan

2026-05-25 16:18:41 +08:00

elastic_hypotheses.md

Docs: reconcile routing docs with current hybrid direction

2026-05-25 10:47:14 +08:00

elastic_offload_design.md

Elastic P2P offload: TTFT p50 -49% vs baseline (0.551 vs 1.080)

2026-05-22 13:50:25 +08:00

kv_lifecycle_design.md

KV cache lifecycle design + eviction loss analysis

2026-05-22 01:27:22 +08:00

lpwl_5policy_600s.md

Add leastwork_kappa decode-aware ablation (net-negative, documented)

2026-05-29 17:07:23 +08:00

overnight_work_report.md

Update report: adaptive v2 confirms no KV transfer helps single-machine

2026-05-22 10:15:08 +08:00

pd_separation_analysis.md

PD-disagg docs: annotated corrections for e13391e contamination

2026-05-31 20:14:14 +08:00

research_findings.md

Docs: reconcile routing docs with current hybrid direction

2026-05-25 10:47:14 +08:00

unified_routing_fix_review.md

Docs: reconcile routing docs with current hybrid direction

2026-05-25 10:47:14 +08:00