Gahow Wang
0881942cf3
After the B3 audit bug fixes (joined_analysis hotspot median + b3_analyze percentile interp), regenerate b3_policy_comparison.json and the per-policy hotspot_index.json from the same raw run on dash0 and re-render the three affected figures (apc-vs-hotspot, latency-bars, per-worker TTFT). Key number changes in window_1_results.md: - hotspot_index magnitudes corrected (all five policies; lmetric smallest delta at +0.7%, sticky largest at +16.1%) - "capped reduces hotspot 13%" -> "~10% (2.253 -> 2.020)" - TTFT/E2E/TPOT percentiles shift by <1% from floor->interp (unified TTFT p90 7.24 -> 7.35 s) Restructured "Caveats" into "Limitations (read this before quoting B3 numbers)": 1. Agentic dispatch coupling is by design — promoted from caveat to top-level methodology framing, tied to agentic_dispatch_coupling.md 2. B3 interference_index is binary (not size-graded) — added 3. Hot-sweep cache contamination (<1%) — kept 4. Unified interference unrecoverable — kept with explicit warning not to read unified's failure attribution as causal 5. w600 is a sample, not full trace — kept 6. Reuse decomposition is per-token in expectation — added current_results/characterization_claim_matrix.md updates: - The "heavy-tail not sole cause" claim now cites the corrected ~10% drop with the median bug noted - New supported claim: "B3 saturated-replay latency gaps include an agentic dispatch-coupling feedback term, which is intentional and matches production"; cited against agentic_dispatch_coupling.md. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
24 lines
919 B
JSON
24 lines
919 B
JSON
{
|
|
"hotspot_index_ttft_p90": 3.667136528736114,
|
|
"per_worker_latency_p90_s": {
|
|
"http://127.0.0.1:8000": 41.42001512600109,
|
|
"http://127.0.0.1:8001": 12.4878579101933,
|
|
"http://127.0.0.1:8002": 22.462878945574648,
|
|
"http://127.0.0.1:8003": 15.501050900109117,
|
|
"http://127.0.0.1:8004": 39.956250199786155,
|
|
"http://127.0.0.1:8005": 36.69850301651168,
|
|
"http://127.0.0.1:8006": 10.116177947795954,
|
|
"http://127.0.0.1:8007": 20.35038618039107
|
|
},
|
|
"per_worker_ttft_p90_s": {
|
|
"http://127.0.0.1:8000": 11.264844838529825,
|
|
"http://127.0.0.1:8001": 3.6063860427122614,
|
|
"http://127.0.0.1:8002": 16.175747957825664,
|
|
"http://127.0.0.1:8003": 9.314684258581842,
|
|
"http://127.0.0.1:8004": 37.73397144810297,
|
|
"http://127.0.0.1:8005": 18.328030522551852,
|
|
"http://127.0.0.1:8006": 3.6328767628350773,
|
|
"http://127.0.0.1:8007": 7.772977900883419
|
|
},
|
|
"status": "supported"
|
|
} |