Gahow Wang
0881942cf3
After the B3 audit bug fixes (joined_analysis hotspot median + b3_analyze percentile interp), regenerate b3_policy_comparison.json and the per-policy hotspot_index.json from the same raw run on dash0 and re-render the three affected figures (apc-vs-hotspot, latency-bars, per-worker TTFT). Key number changes in window_1_results.md: - hotspot_index magnitudes corrected (all five policies; lmetric smallest delta at +0.7%, sticky largest at +16.1%) - "capped reduces hotspot 13%" -> "~10% (2.253 -> 2.020)" - TTFT/E2E/TPOT percentiles shift by <1% from floor->interp (unified TTFT p90 7.24 -> 7.35 s) Restructured "Caveats" into "Limitations (read this before quoting B3 numbers)": 1. Agentic dispatch coupling is by design — promoted from caveat to top-level methodology framing, tied to agentic_dispatch_coupling.md 2. B3 interference_index is binary (not size-graded) — added 3. Hot-sweep cache contamination (<1%) — kept 4. Unified interference unrecoverable — kept with explicit warning not to read unified's failure attribution as causal 5. w600 is a sample, not full trace — kept 6. Reuse decomposition is per-token in expectation — added current_results/characterization_claim_matrix.md updates: - The "heavy-tail not sole cause" claim now cites the corrected ~10% drop with the median bug noted - New supported claim: "B3 saturated-replay latency gaps include an agentic dispatch-coupling feedback term, which is intentional and matches production"; cited against agentic_dispatch_coupling.md. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
24 lines
918 B
JSON
24 lines
918 B
JSON
{
|
|
"hotspot_index_ttft_p90": 2.727756623171119,
|
|
"per_worker_latency_p90_s": {
|
|
"http://127.0.0.1:8000": 30.185792533413043,
|
|
"http://127.0.0.1:8001": 47.49661003401852,
|
|
"http://127.0.0.1:8002": 22.069474861002554,
|
|
"http://127.0.0.1:8003": 83.73774532350944,
|
|
"http://127.0.0.1:8004": 22.03310715127737,
|
|
"http://127.0.0.1:8005": 33.024566102202556,
|
|
"http://127.0.0.1:8006": 61.65600914339302,
|
|
"http://127.0.0.1:8007": 6.077459598158019
|
|
},
|
|
"per_worker_ttft_p90_s": {
|
|
"http://127.0.0.1:8000": 12.284569517592924,
|
|
"http://127.0.0.1:8001": 23.570226482005094,
|
|
"http://127.0.0.1:8002": 5.202772857400123,
|
|
"http://127.0.0.1:8003": 55.37555769548635,
|
|
"http://127.0.0.1:8004": 17.031311958114394,
|
|
"http://127.0.0.1:8005": 25.48531596700202,
|
|
"http://127.0.0.1:8006": 36.31029207323453,
|
|
"http://127.0.0.1:8007": 2.4984901855932535
|
|
},
|
|
"status": "supported"
|
|
} |